Class cascading.TrapPlatformTest

11

tests

0

failures

0

ignored

3m52.61s

duration

100%

successful

Tests

Test Duration Result
testTrapEachAll 19.750s passed
testTrapEachAllChained 15.042s passed
testTrapEachAllSequence 19.446s passed
testTrapEachEveryAllChained 47.479s passed
testTrapEveryAllAtAggregate 19.609s passed
testTrapEveryAllAtComplete 19.899s passed
testTrapEveryAllAtStart 19.658s passed
testTrapNoOperation 16.535s passed
testTrapNone 19.811s passed
testTrapTapSourceSink 15.570s passed
testTrapToSequenceFile 19.814s passed

Standard output

2015-03-13 10:30:32,136 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-03-13 10:30:32,165 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-03-13 10:30:32,166 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.TrapPlatformTest
2015-03-13 10:30:32,179 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(117)) - using cluster
2015-03-13 10:30:32,719 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-03-13 10:30:32,770 INFO  namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:30:32,770 INFO  namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:30:32,771 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2015-03-13 10:30:32,772 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:30:32,775 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:30:32,776 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:32,777 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:30:32,777 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^21 = 2097152 entries
2015-03-13 10:30:32,783 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:30:32,783 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication         = 3
2015-03-13 10:30:32,784 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication             = 512
2015-03-13 10:30:32,785 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication             = 1
2015-03-13 10:30:32,785 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams      = 2
2015-03-13 10:30:32,785 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks  = false
2015-03-13 10:30:32,785 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:30:32,786 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer        = false
2015-03-13 10:30:32,792 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner             = soberoi (auth:SIMPLE)
2015-03-13 10:30:32,792 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup          = supergroup
2015-03-13 10:30:32,793 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:30:32,794 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:30:32,796 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:30:33,078 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:30:33,078 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:33,079 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:30:33,079 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^20 = 1048576 entries
2015-03-13 10:30:33,081 INFO  namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:30:33,083 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:30:33,083 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:30:33,084 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension     = 0
2015-03-13 10:30:33,085 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:30:33,085 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:30:33,087 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:30:33,087 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:33,087 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:30:33,087 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^15 = 32768 entries
2015-03-13 10:30:33,129 INFO  common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1 has been successfully formatted.
2015-03-13 10:30:33,130 INFO  common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2 has been successfully formatted.
2015-03-13 10:30:33,142 INFO  namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:30:33,142 INFO  namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:30:33,152 INFO  namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:30:33,152 INFO  namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:30:33,158 INFO  namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(177)) - Going to retain 1 images with txid >= 0
2015-03-13 10:30:33,190 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-03-13 10:30:33,231 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(344)) - Scheduled snapshot period at 10 second(s).
2015-03-13 10:30:33,231 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:start(183)) - NameNode metrics system started
2015-03-13 10:30:33,274 INFO  mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-03-13 10:30:33,311 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:33,314 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-03-13 10:30:33,314 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:33,314 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:33,324 INFO  http.HttpServer (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:33,334 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52442
2015-03-13 10:30:33,334 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:33,354 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/hdfs to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52442_hdfs____.5mg8kh/webapp
2015-03-13 10:30:33,560 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52442
2015-03-13 10:30:33,560 INFO  namenode.NameNode (NameNode.java:setHttpServerAddress(439)) - Web-server up at: localhost:52442
2015-03-13 10:30:33,563 INFO  namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:30:33,563 INFO  namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:30:33,564 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:30:33,564 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:30:33,564 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:33,565 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:30:33,565 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^21 = 2097152 entries
2015-03-13 10:30:33,566 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:30:33,567 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication         = 3
2015-03-13 10:30:33,567 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication             = 512
2015-03-13 10:30:33,568 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication             = 1
2015-03-13 10:30:33,568 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams      = 2
2015-03-13 10:30:33,568 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks  = false
2015-03-13 10:30:33,569 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:30:33,569 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer        = false
2015-03-13 10:30:33,569 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner             = soberoi (auth:SIMPLE)
2015-03-13 10:30:33,570 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup          = supergroup
2015-03-13 10:30:33,570 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:30:33,571 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:30:33,571 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:30:33,571 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:30:33,572 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:33,572 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:30:33,572 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^20 = 1048576 entries
2015-03-13 10:30:33,573 INFO  namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:30:33,574 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:30:33,574 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:30:33,574 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension     = 0
2015-03-13 10:30:33,575 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:30:33,575 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:30:33,576 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:30:33,576 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:33,576 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:30:33,576 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^15 = 32768 entries
2015-03-13 10:30:33,581 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:33,584 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:33,588 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current
2015-03-13 10:30:33,588 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current
2015-03-13 10:30:33,589 INFO  namenode.FSImage (FSImage.java:loadFSImage(627)) - No edit log streams selected.
2015-03-13 10:30:33,599 INFO  namenode.FSImage (FSImageFormat.java:load(330)) - Loading image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 using no compression
2015-03-13 10:30:33,599 INFO  namenode.FSImage (FSImageFormat.java:load(333)) - Number of files = 1
2015-03-13 10:30:33,601 INFO  namenode.FSImage (FSImageFormat.java:loadFilesUnderConstruction(815)) - Number of files under construction = 0
2015-03-13 10:30:33,601 INFO  namenode.FSImage (FSImageFormat.java:load(365)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 of size 199 bytes loaded in 0 seconds.
2015-03-13 10:30:33,602 INFO  namenode.FSImage (FSImage.java:loadFSImage(837)) - Loaded image for txid 0 from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000
2015-03-13 10:30:33,606 INFO  namenode.FSEditLog (FSEditLog.java:startLogSegment(1010)) - Starting log segment at 1
2015-03-13 10:30:33,657 INFO  namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2015-03-13 10:30:33,657 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(571)) - Finished loading FSImage in 80 msecs
2015-03-13 10:30:33,772 INFO  namenode.NameNode (NameNodeRpcServer.java:<init>(271)) - RPC server is binding to localhost:0
2015-03-13 10:30:33,784 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52443
2015-03-13 10:30:33,800 INFO  namenode.FSNamesystem (FSNamesystem.java:registerMBean(5310)) - Registered FSNamesystemState MBean
2015-03-13 10:30:33,815 INFO  namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:30:33,815 INFO  namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:30:33,815 INFO  namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(4475)) - initializing replication queues
2015-03-13 10:30:33,823 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2316)) - Total number of blocks            = 0
2015-03-13 10:30:33,823 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2317)) - Number of invalid blocks          = 0
2015-03-13 10:30:33,823 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2318)) - Number of under-replicated blocks = 0
2015-03-13 10:30:33,824 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2319)) - Number of  over-replicated blocks = 0
2015-03-13 10:30:33,824 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2321)) - Number of blocks being written    = 0
2015-03-13 10:30:33,824 INFO  hdfs.StateChange (FSNamesystem.java:initializeReplQueues(4480)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 8 msec
2015-03-13 10:30:33,824 INFO  hdfs.StateChange (FSNamesystem.java:leave(4444)) - STATE* Leaving safe mode after 0 secs
2015-03-13 10:30:33,825 INFO  hdfs.StateChange (FSNamesystem.java:leave(4455)) - STATE* Network topology has 0 racks and 0 datanodes
2015-03-13 10:30:33,825 INFO  hdfs.StateChange (FSNamesystem.java:leave(4458)) - STATE* UnderReplicatedBlocks has 0 blocks
2015-03-13 10:30:33,845 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:33,845 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52443: starting
2015-03-13 10:30:33,847 INFO  namenode.NameNode (NameNode.java:startCommonServices(570)) - NameNode RPC up at: localhost/127.0.0.1:52443
2015-03-13 10:30:33,847 INFO  namenode.FSNamesystem (FSNamesystem.java:startActiveServices(886)) - Starting services required for active state
2015-03-13 10:30:33,967 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 0 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2
2015-03-13 10:30:34,026 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:30:34,027 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:30:34,034 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:52444
2015-03-13 10:30:34,037 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:30:34,039 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:34,040 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:30:34,041 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:34,041 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:34,042 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:30:34,044 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:34,044 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52445
2015-03-13 10:30:34,044 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:34,047 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52445_datanode____.adgh0h/webapp
2015-03-13 10:30:34,154 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52445
2015-03-13 10:30:34,162 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52446
2015-03-13 10:30:34,166 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:52446
2015-03-13 10:30:34,174 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:30:34,177 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:30:34,185 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:52443 starting to offer service
2015-03-13 10:30:34,187 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:34,187 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52446: starting
2015-03-13 10:30:34,194 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 1 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4
2015-03-13 10:30:34,229 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:30:34,230 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:30:34,231 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:52447
2015-03-13 10:30:34,231 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:30:34,232 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:34,233 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:30:34,234 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:34,234 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:34,235 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:30:34,236 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:34,236 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52448
2015-03-13 10:30:34,236 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:34,253 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52448_datanode____.oxien2/webapp
2015-03-13 10:30:34,373 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,374 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1 is not formatted
2015-03-13 10:30:34,374 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,375 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,375 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2 is not formatted
2015-03-13 10:30:34,375 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,377 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52448
2015-03-13 10:30:34,378 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52450
2015-03-13 10:30:34,380 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:52450
2015-03-13 10:30:34,388 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:30:34,389 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:30:34,390 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:52443 starting to offer service
2015-03-13 10:30:34,394 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,394 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3 is not formatted
2015-03-13 10:30:34,394 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,395 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,395 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4 is not formatted
2015-03-13 10:30:34,395 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,420 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:34,430 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52450: starting
2015-03-13 10:30:34,439 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,440 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,440 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,440 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,441 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,441 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,441 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,441 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,443 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=1850867028;bpid=BP-1641873285-10.1.1.144-1426267833098;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0;bpid=BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,450 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,451 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,451 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,451 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,452 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,452 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,452 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,452 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,454 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=1850867028;bpid=BP-1641873285-10.1.1.144-1426267833098;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0;bpid=BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,456 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current
2015-03-13 10:30:34,456 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current
2015-03-13 10:30:34,457 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current
2015-03-13 10:30:34,457 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current
2015-03-13 10:30:34,461 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:30:34,461 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:30:34,466 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426281252466 with interval 21600000
2015-03-13 10:30:34,467 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426283994467 with interval 21600000
2015-03-13 10:30:34,467 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,467 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,468 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:30:34,468 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:30:34,468 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:30:34,469 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:30:34,480 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 12ms
2015-03-13 10:30:34,480 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 12ms
2015-03-13 10:30:34,480 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 12ms
2015-03-13 10:30:34,480 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 11ms
2015-03-13 10:30:34,481 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1641873285-10.1.1.144-1426267833098: 14ms
2015-03-13 10:30:34,481 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:30:34,481 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1641873285-10.1.1.144-1426267833098: 14ms
2015-03-13 10:30:34,481 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 0ms
2015-03-13 10:30:34,482 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:30:34,481 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:30:34,482 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 0ms
2015-03-13 10:30:34,482 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:30:34,482 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 0ms
2015-03-13 10:30:34,482 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:30:34,483 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 0ms
2015-03-13 10:30:34,483 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 2ms
2015-03-13 10:30:34,484 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 2 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6
2015-03-13 10:30:34,484 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-898105819-10.1.1.144-52447-1426267834396) service to localhost/127.0.0.1:52443 beginning handshake with NN
2015-03-13 10:30:34,484 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-218115309-10.1.1.144-52444-1426267834377) service to localhost/127.0.0.1:52443 beginning handshake with NN
2015-03-13 10:30:34,494 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) storage DS-218115309-10.1.1.144-52444-1426267834377
2015-03-13 10:30:34,496 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:52444
2015-03-13 10:30:34,497 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-898105819-10.1.1.144-52447-1426267834396, infoPort=52448, ipcPort=52450, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) storage DS-898105819-10.1.1.144-52447-1426267834396
2015-03-13 10:30:34,497 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:52447
2015-03-13 10:30:34,500 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-218115309-10.1.1.144-52444-1426267834377) service to localhost/127.0.0.1:52443 successfully registered with NN
2015-03-13 10:30:34,500 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:52443 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:30:34,500 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-898105819-10.1.1.144-52447-1426267834396) service to localhost/127.0.0.1:52443 successfully registered with NN
2015-03-13 10:30:34,500 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:52443 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:30:34,512 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:30:34,512 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:30:34,513 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:52451
2015-03-13 10:30:34,513 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:30:34,515 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:34,516 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:30:34,517 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:34,517 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:34,518 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:30:34,519 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:34,519 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52452
2015-03-13 10:30:34,519 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:34,523 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52452_datanode____.46eex1/webapp
2015-03-13 10:30:34,545 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-898105819-10.1.1.144-52447-1426267834396) service to localhost/127.0.0.1:52443 trying to claim ACTIVE state with txid=1
2015-03-13 10:30:34,545 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-898105819-10.1.1.144-52447-1426267834396) service to localhost/127.0.0.1:52443
2015-03-13 10:30:34,545 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-218115309-10.1.1.144-52444-1426267834377) service to localhost/127.0.0.1:52443 trying to claim ACTIVE state with txid=1
2015-03-13 10:30:34,545 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-218115309-10.1.1.144-52444-1426267834377) service to localhost/127.0.0.1:52443
2015-03-13 10:30:34,557 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:52447 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:30:34,557 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:52444 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:30:34,557 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-898105819-10.1.1.144-52447-1426267834396, infoPort=52448, ipcPort=52450, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0), blocks: 0, processing time: 1 msecs
2015-03-13 10:30:34,558 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0), blocks: 0, processing time: 1 msecs
2015-03-13 10:30:34,575 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 2 msec to generate and 28 msecs for RPC and NN processing
2015-03-13 10:30:34,576 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@19bf8e26
2015-03-13 10:30:34,576 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 30 msecs for RPC and NN processing
2015-03-13 10:30:34,576 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@6f0d6dfe
2015-03-13 10:30:34,579 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:30:34,579 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:34,579 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:30:34,579 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:30:34,579 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:34,580 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:30:34,580 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:30:34,579 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:30:34,580 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,580 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,583 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1641873285-10.1.1.144-1426267833098 to blockPoolScannerMap, new size=1
2015-03-13 10:30:34,584 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1641873285-10.1.1.144-1426267833098 to blockPoolScannerMap, new size=1
2015-03-13 10:30:34,648 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52452
2015-03-13 10:30:34,649 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52453
2015-03-13 10:30:34,652 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:52453
2015-03-13 10:30:34,656 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:30:34,657 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:30:34,658 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:52443 starting to offer service
2015-03-13 10:30:34,658 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:34,659 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52453: starting
2015-03-13 10:30:34,661 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 3 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8
2015-03-13 10:30:34,661 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,662 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5 is not formatted
2015-03-13 10:30:34,662 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,663 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,663 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6 is not formatted
2015-03-13 10:30:34,664 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,689 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:30:34,689 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:30:34,690 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:52454
2015-03-13 10:30:34,690 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:30:34,692 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:34,693 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:30:34,693 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:34,694 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:34,695 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:30:34,696 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:30:34,696 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52455
2015-03-13 10:30:34,696 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:34,701 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_52455_datanode____.iqgcjm/webapp
2015-03-13 10:30:34,706 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,707 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,707 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,707 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,708 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,708 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,708 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,708 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,709 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=1850867028;bpid=BP-1641873285-10.1.1.144-1426267833098;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0;bpid=BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,710 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current
2015-03-13 10:30:34,710 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current
2015-03-13 10:30:34,710 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:30:34,712 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426268648712 with interval 21600000
2015-03-13 10:30:34,712 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,713 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:30:34,713 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:30:34,719 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 6ms
2015-03-13 10:30:34,719 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 6ms
2015-03-13 10:30:34,719 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1641873285-10.1.1.144-1426267833098: 6ms
2015-03-13 10:30:34,719 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:30:34,720 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 0ms
2015-03-13 10:30:34,720 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:30:34,720 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 0ms
2015-03-13 10:30:34,720 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:30:34,720 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-79468681-10.1.1.144-52451-1426267834665) service to localhost/127.0.0.1:52443 beginning handshake with NN
2015-03-13 10:30:34,721 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) storage DS-79468681-10.1.1.144-52451-1426267834665
2015-03-13 10:30:34,722 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:52451
2015-03-13 10:30:34,723 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-79468681-10.1.1.144-52451-1426267834665) service to localhost/127.0.0.1:52443 successfully registered with NN
2015-03-13 10:30:34,723 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:52443 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:30:34,724 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-79468681-10.1.1.144-52451-1426267834665) service to localhost/127.0.0.1:52443 trying to claim ACTIVE state with txid=1
2015-03-13 10:30:34,724 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-79468681-10.1.1.144-52451-1426267834665) service to localhost/127.0.0.1:52443
2015-03-13 10:30:34,725 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:52451 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:30:34,726 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0), blocks: 0, processing time: 1 msecs
2015-03-13 10:30:34,726 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 1 msecs for RPC and NN processing
2015-03-13 10:30:34,726 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@28312cbb
2015-03-13 10:30:34,727 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:30:34,727 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:34,727 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:30:34,727 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:30:34,727 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,728 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1641873285-10.1.1.144-1426267833098 to blockPoolScannerMap, new size=1
2015-03-13 10:30:34,809 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:52455
2015-03-13 10:30:34,810 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52456
2015-03-13 10:30:34,813 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:52456
2015-03-13 10:30:34,817 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:30:34,818 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:30:34,819 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:52443 starting to offer service
2015-03-13 10:30:34,819 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:34,819 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52456: starting
2015-03-13 10:30:34,822 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,822 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7 is not formatted
2015-03-13 10:30:34,822 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,823 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/in_use.lock acquired by nodename 97373@Edinburgh.local
2015-03-13 10:30:34,823 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8 is not formatted
2015-03-13 10:30:34,823 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:30:34,861 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,862 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,862 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,862 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,863 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:30:34,863 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098 is not formatted.
2015-03-13 10:30:34,863 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:30:34,863 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1641873285-10.1.1.144-1426267833098 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current
2015-03-13 10:30:34,865 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=1850867028;bpid=BP-1641873285-10.1.1.144-1426267833098;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0;bpid=BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,865 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current
2015-03-13 10:30:34,865 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current
2015-03-13 10:30:34,866 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:30:34,867 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426273383867 with interval 21600000
2015-03-13 10:30:34,867 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,868 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:30:34,868 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:30:34,875 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 7ms
2015-03-13 10:30:34,875 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1641873285-10.1.1.144-1426267833098 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 7ms
2015-03-13 10:30:34,875 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1641873285-10.1.1.144-1426267833098: 8ms
2015-03-13 10:30:34,875 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:30:34,875 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 0ms
2015-03-13 10:30:34,875 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:30:34,876 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1641873285-10.1.1.144-1426267833098 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 1ms
2015-03-13 10:30:34,876 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:30:34,876 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-1285499800-10.1.1.144-52454-1426267834827) service to localhost/127.0.0.1:52443 beginning handshake with NN
2015-03-13 10:30:34,877 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) storage DS-1285499800-10.1.1.144-52454-1426267834827
2015-03-13 10:30:34,877 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:52454
2015-03-13 10:30:34,878 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-1285499800-10.1.1.144-52454-1426267834827) service to localhost/127.0.0.1:52443 successfully registered with NN
2015-03-13 10:30:34,878 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:52443 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:30:34,879 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-1285499800-10.1.1.144-52454-1426267834827) service to localhost/127.0.0.1:52443 trying to claim ACTIVE state with txid=1
2015-03-13 10:30:34,880 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1641873285-10.1.1.144-1426267833098 (storage id DS-1285499800-10.1.1.144-52454-1426267834827) service to localhost/127.0.0.1:52443
2015-03-13 10:30:34,881 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:52454 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:30:34,881 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:30:34,882 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 2 msecs for RPC and NN processing
2015-03-13 10:30:34,882 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@1a1d2fe0
2015-03-13 10:30:34,882 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:30:34,882 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:30:34,882 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:30:34,883 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:30:34,883 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1641873285-10.1.1.144-1426267833098
2015-03-13 10:30:34,883 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1641873285-10.1.1.144-1426267833098 to blockPoolScannerMap, new size=1
2015-03-13 10:30:35,121 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(1891)) - Cluster is active
2015-03-13 10:30:35,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:35,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:35,180 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:30:35,206 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001 src: /127.0.0.1:52458 dest: /127.0.0.1:52444
2015-03-13 10:30:35,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001 src: /127.0.0.1:52459 dest: /127.0.0.1:52454
2015-03-13 10:30:35,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001 src: /127.0.0.1:52460 dest: /127.0.0.1:52451
2015-03-13 10:30:35,232 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52460, dest: /127.0.0.1:52451, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 6480000
2015-03-13 10:30:35,232 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:35,232 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:35,233 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52459, dest: /127.0.0.1:52454, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 9241000
2015-03-13 10:30:35,234 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:35,234 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52458, dest: /127.0.0.1:52444, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 10180000
2015-03-13 10:30:35,235 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:35,235 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:35,235 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:35,238 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:35,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:30:35,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:35,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:35,344 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:30:35,346 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002 src: /127.0.0.1:52461 dest: /127.0.0.1:52447
2015-03-13 10:30:35,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002 src: /127.0.0.1:52462 dest: /127.0.0.1:52444
2015-03-13 10:30:35,349 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002 src: /127.0.0.1:52463 dest: /127.0.0.1:52454
2015-03-13 10:30:35,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52463, dest: /127.0.0.1:52454, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 4505000
2015-03-13 10:30:35,355 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:35,355 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:35,356 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52462, dest: /127.0.0.1:52444, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 5500000
2015-03-13 10:30:35,356 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:35,356 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:35,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52461, dest: /127.0.0.1:52447, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 6358000
2015-03-13 10:30:35,357 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:35,357 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:35,359 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:35,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:30:35,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging	dst=null	perm=null
2015-03-13 10:30:35,638 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceInit(150)) - mkdir: hdfs://localhost:52443/tmp/hadoop-yarn/staging
2015-03-13 10:30:35,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:35,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:35,678 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:30:35,684 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:<init>(75)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-03-13 10:30:35,687 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:<init>(77)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
2015-03-13 10:30:35,688 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-03-13 10:30:35,690 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-03-13 10:30:35,690 INFO  resourcemanager.ResourceManager (ResourceManager.java:createScheduler(328)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
2015-03-13 10:30:35,717 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-03-13 10:30:35,718 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-03-13 10:30:35,718 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-03-13 10:30:35,719 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-03-13 10:30:35,730 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - ResourceManager metrics system started (again)
2015-03-13 10:30:35,759 INFO  capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(189)) - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=SUBMIT_APPLICATIONS:*ADMINISTER_QUEUE:*
2015-03-13 10:30:35,759 INFO  capacity.ParentQueue (ParentQueue.java:<init>(151)) - Initialized parent-queue root name=root, fullname=root
2015-03-13 10:30:35,765 INFO  capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(271)) - Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
maxActiveApplications = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) * maxAMResourcePerQueuePercent * absoluteMaxCapacity),1) ]
maxActiveAppsUsingAbsCap = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) *maxAMResourcePercent * absoluteCapacity),1) ]
maxActiveApplicationsPerUser = 1 [= max((int)(maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),1) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = SUBMIT_APPLICATIONS:*ADMINISTER_QUEUE:* [= configuredAcls ]
nodeLocalityDelay = 0

2015-03-13 10:30:35,766 INFO  capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:30:35,766 INFO  capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:30:35,767 INFO  capacity.CapacityScheduler (CapacityScheduler.java:initializeQueues(307)) - Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:30:35,767 INFO  capacity.CapacityScheduler (CapacityScheduler.java:reinitialize(271)) - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192, vCores:32>>
2015-03-13 10:30:35,812 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-03-13 10:30:35,817 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-03-13 10:30:35,818 INFO  resourcemanager.RMNMInfo (RMNMInfo.java:<init>(63)) - Registered RMNMInfo MBean
2015-03-13 10:30:35,819 INFO  util.HostsFileReader (HostsFileReader.java:refresh(84)) - Refreshing hosts (include/exclude) list
2015-03-13 10:30:35,820 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(225)) - Waiting for RM to start...
2015-03-13 10:30:35,821 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(103)) - Rolling master-key for container-tokens
2015-03-13 10:30:35,821 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:30:35,823 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(97)) - Rolling master-key for nm-tokens
2015-03-13 10:30:35,830 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:35,830 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-03-13 10:30:35,830 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:35,830 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:35,831 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /cluster/*
2015-03-13 10:30:35,831 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:35,832 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52464
2015-03-13 10:30:35,832 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:35,835 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/cluster to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52464_cluster____.akgizd/webapp
2015-03-13 10:30:35,889 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52464
2015-03-13 10:30:35,889 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /cluster started at 52464
2015-03-13 10:30:36,086 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:36,087 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:30:36,087 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 1
2015-03-13 10:30:36,088 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:30:36,089 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:30:36,089 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 2
2015-03-13 10:30:36,098 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52465
2015-03-13 10:30:36,100 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-03-13 10:30:36,100 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:36,100 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52465: starting
2015-03-13 10:30:36,111 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52466
2015-03-13 10:30:36,113 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
2015-03-13 10:30:36,114 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:36,114 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52466: starting
2015-03-13 10:30:36,134 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52467
2015-03-13 10:30:36,136 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
2015-03-13 10:30:36,136 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:36,136 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52467: starting
2015-03-13 10:30:36,153 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52468
2015-03-13 10:30:36,155 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2015-03-13 10:30:36,155 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:36,155 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52468: starting
2015-03-13 10:30:37,326 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(238)) - MiniYARN ResourceManager address: 10.1.1.144:52467
2015-03-13 10:30:37,326 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(240)) - MiniYARN ResourceManager web address: Edinburgh.local:52464
2015-03-13 10:30:37,327 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0
2015-03-13 10:30:37,327 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1
2015-03-13 10:30:37,328 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2
2015-03-13 10:30:37,328 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3
2015-03-13 10:30:37,338 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_0
2015-03-13 10:30:37,339 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_1
2015-03-13 10:30:37,339 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_2
2015-03-13 10:30:37,339 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_3
2015-03-13 10:30:37,339 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 0
2015-03-13 10:30:37,375 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:30:37,376 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:30:37,376 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:30:37,377 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:30:37,377 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:30:37,377 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:30:37,378 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:30:37,379 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:30:37,379 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:30:37,384 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:30:37,384 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:30:37,522 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:30:37,535 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:30:37,535 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:30:37,552 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:30:37,552 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:30:37,552 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:30:37,553 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:30:37,553 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:30:37,554 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 0 to start...
2015-03-13 10:30:37,564 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52469
2015-03-13 10:30:37,566 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:30:37,567 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:30:37,568 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:37,568 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52469: starting
2015-03-13 10:30:37,574 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:52469
2015-03-13 10:30:37,574 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:52469
2015-03-13 10:30:37,581 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52470
2015-03-13 10:30:37,584 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:30:37,584 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:37,584 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52470: starting
2015-03-13 10:30:37,586 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 52470
2015-03-13 10:30:37,594 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:30:37,602 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 52471
2015-03-13 10:30:37,603 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:37,603 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:30:37,604 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:37,604 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:30:37,604 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:37,604 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:37,605 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:30:37,605 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:37,606 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52472
2015-03-13 10:30:37,606 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:37,608 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52472_node____gd9cs8/webapp
2015-03-13 10:30:38,458 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52472
2015-03-13 10:30:38,459 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 52472
2015-03-13 10:30:38,480 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:38,494 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:30:38,496 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 52469 httpPort: 52472) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:52469
2015-03-13 10:30:38,496 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -152746155
2015-03-13 10:30:38,497 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1705936752
2015-03-13 10:30:38,497 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:52469 with total resource of <memory:4096, vCores:8>
2015-03-13 10:30:38,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:30:38,499 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:52469 Node Transitioned from NEW to RUNNING
2015-03-13 10:30:38,501 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:52469 clusterResource: <memory:4096, vCores:8>
2015-03-13 10:30:38,559 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0
2015-03-13 10:30:38,560 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1
2015-03-13 10:30:38,560 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2
2015-03-13 10:30:38,560 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3
2015-03-13 10:30:38,575 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_0
2015-03-13 10:30:38,576 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_1
2015-03-13 10:30:38,576 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_2
2015-03-13 10:30:38,576 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_3
2015-03-13 10:30:38,577 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 1
2015-03-13 10:30:38,592 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:30:38,592 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:30:38,593 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:30:38,593 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:30:38,593 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:30:38,593 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:30:38,593 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:30:38,594 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:30:38,594 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:30:38,595 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:30:38,596 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:30:38,709 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:30:38,711 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:30:38,711 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:30:38,714 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:30:38,715 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:30:38,715 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:30:38,715 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:30:38,716 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:30:38,716 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 1 to start...
2015-03-13 10:30:38,719 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52473
2015-03-13 10:30:38,722 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:30:38,722 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:30:38,723 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:38,723 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52473: starting
2015-03-13 10:30:38,727 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:52473
2015-03-13 10:30:38,727 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:52473
2015-03-13 10:30:38,728 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52474
2015-03-13 10:30:38,731 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:30:38,731 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:38,731 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52474: starting
2015-03-13 10:30:38,733 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 52474
2015-03-13 10:30:38,735 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:30:38,736 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 52475
2015-03-13 10:30:38,736 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:38,738 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:30:38,738 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:38,739 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:30:38,739 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:38,739 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:38,740 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:30:38,740 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:38,740 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52476
2015-03-13 10:30:38,740 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:38,743 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52476_node____.w62oec/webapp
2015-03-13 10:30:38,981 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52476
2015-03-13 10:30:38,982 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 52476
2015-03-13 10:30:38,988 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:38,990 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:30:38,990 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:52473 Node Transitioned from NEW to RUNNING
2015-03-13 10:30:38,990 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 52473 httpPort: 52476) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:52473
2015-03-13 10:30:38,990 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:52473 clusterResource: <memory:8192, vCores:16>
2015-03-13 10:30:38,990 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -152746155
2015-03-13 10:30:38,990 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1705936752
2015-03-13 10:30:38,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:52473 with total resource of <memory:4096, vCores:8>
2015-03-13 10:30:38,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:30:39,473 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002
2015-03-13 10:30:39,475 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001
2015-03-13 10:30:39,481 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002
2015-03-13 10:30:39,721 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0
2015-03-13 10:30:39,721 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1
2015-03-13 10:30:39,722 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2
2015-03-13 10:30:39,722 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3
2015-03-13 10:30:39,723 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001
2015-03-13 10:30:39,732 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_0
2015-03-13 10:30:39,732 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_1
2015-03-13 10:30:39,732 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_2
2015-03-13 10:30:39,732 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_3
2015-03-13 10:30:39,733 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 2
2015-03-13 10:30:39,742 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:30:39,742 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:30:39,742 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:30:39,743 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:30:39,743 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:30:39,743 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:30:39,743 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:30:39,744 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:30:39,744 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:30:39,746 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:30:39,746 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:30:39,850 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:30:39,851 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:30:39,851 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:30:39,853 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:30:39,853 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:30:39,854 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:30:39,854 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:30:39,854 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:30:39,854 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 2 to start...
2015-03-13 10:30:39,859 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52477
2015-03-13 10:30:39,862 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:30:39,862 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:30:39,862 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:39,862 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52477: starting
2015-03-13 10:30:39,866 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:52477
2015-03-13 10:30:39,866 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:52477
2015-03-13 10:30:39,867 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52478
2015-03-13 10:30:39,869 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:30:39,870 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:39,870 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52478: starting
2015-03-13 10:30:39,872 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002
2015-03-13 10:30:39,873 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 52478
2015-03-13 10:30:39,874 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:30:39,875 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 52479
2015-03-13 10:30:39,876 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:39,876 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:30:39,877 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:39,877 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:30:39,877 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:39,877 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:39,878 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:30:39,878 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001
2015-03-13 10:30:39,878 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:39,879 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52480
2015-03-13 10:30:39,879 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:39,882 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52480_node____1vddlh/webapp
2015-03-13 10:30:40,058 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52480
2015-03-13 10:30:40,059 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 52480
2015-03-13 10:30:40,066 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:40,067 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:30:40,067 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 52477 httpPort: 52480) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:52477
2015-03-13 10:30:40,067 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:52477 Node Transitioned from NEW to RUNNING
2015-03-13 10:30:40,067 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -152746155
2015-03-13 10:30:40,068 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1705936752
2015-03-13 10:30:40,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:52477 with total resource of <memory:4096, vCores:8>
2015-03-13 10:30:40,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:30:40,068 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:52477 clusterResource: <memory:12288, vCores:24>
2015-03-13 10:30:40,859 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0
2015-03-13 10:30:40,860 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1
2015-03-13 10:30:40,860 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2
2015-03-13 10:30:40,860 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3
2015-03-13 10:30:40,873 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_0
2015-03-13 10:30:40,873 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_1
2015-03-13 10:30:40,874 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_2
2015-03-13 10:30:40,874 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_3
2015-03-13 10:30:40,874 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 3
2015-03-13 10:30:40,887 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:30:40,888 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:30:40,888 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:30:40,888 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:30:40,888 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:30:40,889 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:30:40,889 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:30:40,889 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:30:40,889 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:30:40,892 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:30:40,892 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:30:40,994 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:30:40,995 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:30:40,995 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:30:40,998 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:30:40,998 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:30:40,998 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:30:40,998 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:30:40,999 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:30:40,999 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 3 to start...
2015-03-13 10:30:41,001 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52481
2015-03-13 10:30:41,003 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:30:41,003 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:30:41,004 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:41,004 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52481: starting
2015-03-13 10:30:41,007 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:52481
2015-03-13 10:30:41,008 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:52481
2015-03-13 10:30:41,009 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52482
2015-03-13 10:30:41,010 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:30:41,011 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:41,011 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52482: starting
2015-03-13 10:30:41,013 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 52482
2015-03-13 10:30:41,013 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:30:41,014 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 52483
2015-03-13 10:30:41,014 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:41,015 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:30:41,015 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:41,016 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:30:41,016 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:41,016 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:41,017 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:30:41,017 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:41,017 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52484
2015-03-13 10:30:41,017 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:41,020 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52484_node____od5ee1/webapp
2015-03-13 10:30:41,233 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52484
2015-03-13 10:30:41,233 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 52484
2015-03-13 10:30:41,240 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:41,241 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:30:41,241 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 52481 httpPort: 52484) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:52481
2015-03-13 10:30:41,241 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:52481 Node Transitioned from NEW to RUNNING
2015-03-13 10:30:41,241 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id -152746155
2015-03-13 10:30:41,241 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1705936752
2015-03-13 10:30:41,241 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:52481 clusterResource: <memory:16384, vCores:32>
2015-03-13 10:30:41,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:52481 with total resource of <memory:4096, vCores:8>
2015-03-13 10:30:41,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:30:42,010 INFO  hs.JobHistory (JobHistory.java:serviceInit(77)) - JobHistory Init
2015-03-13 10:30:42,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null
2015-03-13 10:30:42,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:30:42,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:42,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:30:42,026 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(561)) - Perms after creating 511, Expected: 1023
2015-03-13 10:30:42,026 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(564)) - Explicitly setting permissions to : 1023, rwxrwxrwt
2015-03-13 10:30:42,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwt
2015-03-13 10:30:42,030 INFO  hs.HistoryFileManager (HistoryFileManager.java:initExisting(580)) - Initializing Existing Jobs...
2015-03-13 10:30:42,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null
2015-03-13 10:30:42,035 INFO  hs.CachedHistoryStorage (CachedHistoryStorage.java:serviceInit(65)) - CachedHistoryStorage Init
2015-03-13 10:30:42,036 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(207)) - Waiting for HistoryServer to start...
2015-03-13 10:30:42,036 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - JobHistoryServer metrics system started (again)
2015-03-13 10:30:42,036 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:30:42,037 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:30:42,037 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:30:42,040 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:30:42,040 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context jobhistory
2015-03-13 10:30:42,040 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:30:42,040 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:30:42,041 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /jobhistory/*
2015-03-13 10:30:42,041 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:30:42,041 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 52485
2015-03-13 10:30:42,041 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:30:42,044 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/jobhistory to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_52485_jobhistory____.umkp2z/webapp
2015-03-13 10:30:42,209 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:52485
2015-03-13 10:30:42,209 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /jobhistory started at 52485
2015-03-13 10:30:42,228 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:30:42,235 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 52486
2015-03-13 10:30:42,236 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.mapreduce.v2.api.HSClientProtocolPB to the server
2015-03-13 10:30:42,237 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:30:42,237 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 52486: starting
2015-03-13 10:30:42,239 INFO  hs.HistoryClientService (HistoryClientService.java:serviceStart(140)) - Instantiated MRClientService at 10.1.1.144/10.1.1.144:52486
2015-03-13 10:30:43,541 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(224)) - MiniMRYARN ResourceManager address: 10.1.1.144:52467
2015-03-13 10:30:43,542 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(226)) - MiniMRYARN ResourceManager web address: Edinburgh.local:52464
2015-03-13 10:30:43,542 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(228)) - MiniMRYARN HistoryServer address: 10.1.1.144:52486
2015-03-13 10:30:43,543 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(230)) - MiniMRYARN HistoryServer web address: Edinburgh.local:52485
2015-03-13 10:30:43,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:30:43,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:30:43,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,561 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt. BP-1641873285-10.1.1.144-1426267833098 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:30:43,563 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003 src: /127.0.0.1:52487 dest: /127.0.0.1:52451
2015-03-13 10:30:43,564 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003 src: /127.0.0.1:52488 dest: /127.0.0.1:52454
2015-03-13 10:30:43,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003 src: /127.0.0.1:52489 dest: /127.0.0.1:52444
2015-03-13 10:30:43,570 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52489, dest: /127.0.0.1:52444, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 3494000
2015-03-13 10:30:43,570 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:43,571 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:30:43,571 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52488, dest: /127.0.0.1:52454, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 4649000
2015-03-13 10:30:43,572 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,573 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:30:43,573 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52487, dest: /127.0.0.1:52451, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 6039000
2015-03-13 10:30:43,574 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,575 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:30:43,577 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:43,604 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
2015-03-13 10:30:43,604 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-03-13 10:30:43,605 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-03-13 10:30:43,605 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-03-13 10:30:43,605 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:30:43,605 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-03-13 10:30:43,605 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
2015-03-13 10:30:43,606 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-03-13 10:30:43,606 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-03-13 10:30:43,606 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-03-13 10:30:43,606 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-03-13 10:30:43,607 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-03-13 10:30:43,607 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-03-13 10:30:43,607 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-03-13 10:30:43,608 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-03-13 10:30:43,608 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-03-13 10:30:43,608 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-03-13 10:30:43,613 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:30:43,613 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:30:43,619 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: 3066BE8105C74D4DAC7086700201E39F
2015-03-13 10:30:43,654 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-03-13 10:30:43,668 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-03-13 10:30:43,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:30:43,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:30:43,726 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-03-13 10:30:43,728 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:30:43,728 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:30:43,728 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap"]
2015-03-13 10:30:43,729 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:30:43,729 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 2
2015-03-13 10:30:43,729 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 2
2015-03-13 10:30:43,730 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/2)
2015-03-13 10:30:43,771 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:30:43,784 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:30:43,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335	dst=null	perm=null
2015-03-13 10:30:43,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:30:43,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:30:43,817 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 1
2015-03-13 10:30:43,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001	dst=null	perm=null
2015-03-13 10:30:43,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:30:43,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:30:43,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:43,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,833 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:30:43,835 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52491 dest: /127.0.0.1:52451
2015-03-13 10:30:43,837 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52492 dest: /127.0.0.1:52444
2015-03-13 10:30:43,838 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52493 dest: /127.0.0.1:52454
2015-03-13 10:30:43,844 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52493, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 4753000
2015-03-13 10:30:43,845 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:43,845 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:43,846 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52492, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 5694000
2015-03-13 10:30:43,846 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:43,847 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52491, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 7043000
2015-03-13 10:30:43,848 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,849 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:43,850 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:43,852 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar
2015-03-13 10:30:43,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:43,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:43,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:43,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:43,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:30:43,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:30:43,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:30:43,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:30:43,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:30:43,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:43,868 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-03-13 10:30:43,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:30:43,876 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:30:43,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:30:43,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,890 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split
2015-03-13 10:30:43,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:43,894 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:30:43,895 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005 src: /127.0.0.1:52494 dest: /127.0.0.1:52454
2015-03-13 10:30:43,897 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005 src: /127.0.0.1:52495 dest: /127.0.0.1:52447
2015-03-13 10:30:43,898 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005 src: /127.0.0.1:52496 dest: /127.0.0.1:52444
2015-03-13 10:30:43,900 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005 src: /127.0.0.1:52497 dest: /127.0.0.1:52451
2015-03-13 10:30:43,905 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52497, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 3696000
2015-03-13 10:30:43,906 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:43,907 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,907 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52496, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 6031000
2015-03-13 10:30:43,908 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,911 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,911 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52495, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 8828000
2015-03-13 10:30:43,911 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,914 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,914 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52494, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 12310000
2015-03-13 10:30:43,914 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,915 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,917 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:43,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,925 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:30:43,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006 src: /127.0.0.1:52498 dest: /127.0.0.1:52454
2015-03-13 10:30:43,927 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006 src: /127.0.0.1:52499 dest: /127.0.0.1:52444
2015-03-13 10:30:43,929 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006 src: /127.0.0.1:52500 dest: /127.0.0.1:52451
2015-03-13 10:30:43,933 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52500, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 2864000
2015-03-13 10:30:43,933 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:43,934 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,935 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52499, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 4253000
2015-03-13 10:30:43,935 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,936 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,936 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52498, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 5524000
2015-03-13 10:30:43,936 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:43,938 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:43,939 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:43,939 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:30:43,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:30:43,949 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-03-13 10:30:43,949 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-03-13 10:30:43,949 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-03-13 10:30:43,949 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-03-13 10:30:43,949 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-03-13 10:30:43,949 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-03-13 10:30:43,949 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-03-13 10:30:43,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-03-13 10:30:43,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-03-13 10:30:43,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-03-13 10:30:43,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-03-13 10:30:43,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-03-13 10:30:43,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-03-13 10:30:43,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-03-13 10:30:43,950 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-03-13 10:30:43,951 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-03-13 10:30:43,951 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-03-13 10:30:43,951 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-03-13 10:30:43,951 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-03-13 10:30:43,951 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-03-13 10:30:43,951 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-03-13 10:30:43,951 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
2015-03-13 10:30:43,951 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-03-13 10:30:43,952 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-03-13 10:30:43,952 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-03-13 10:30:43,952 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-03-13 10:30:43,952 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-03-13 10:30:43,952 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-03-13 10:30:43,952 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:30:43,952 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-03-13 10:30:43,953 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-03-13 10:30:43,953 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-03-13 10:30:43,953 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-03-13 10:30:43,953 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-03-13 10:30:43,953 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-03-13 10:30:43,953 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-03-13 10:30:43,954 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-03-13 10:30:43,954 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-03-13 10:30:43,954 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-03-13 10:30:43,954 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-03-13 10:30:43,954 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-03-13 10:30:43,954 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-03-13 10:30:43,954 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-03-13 10:30:43,955 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-03-13 10:30:43,955 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-03-13 10:30:43,955 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-03-13 10:30:43,956 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-03-13 10:30:43,956 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-03-13 10:30:43,956 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-03-13 10:30:43,956 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-03-13 10:30:43,956 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-03-13 10:30:43,957 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-03-13 10:30:43,957 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:30:43,957 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-03-13 10:30:43,957 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-03-13 10:30:43,957 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-03-13 10:30:43,957 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-03-13 10:30:43,958 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-03-13 10:30:43,958 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-03-13 10:30:43,958 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-03-13 10:30:43,958 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-03-13 10:30:43,958 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-03-13 10:30:43,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-03-13 10:30:43,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-03-13 10:30:43,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-03-13 10:30:43,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-03-13 10:30:43,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-03-13 10:30:43,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-03-13 10:30:43,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-03-13 10:30:43,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-03-13 10:30:43,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-03-13 10:30:43,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-03-13 10:30:43,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-03-13 10:30:43,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-03-13 10:30:43,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-03-13 10:30:43,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-03-13 10:30:43,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-03-13 10:30:43,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-03-13 10:30:43,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-03-13 10:30:43,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-03-13 10:30:43,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-03-13 10:30:43,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-03-13 10:30:43,962 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-03-13 10:30:43,962 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-03-13 10:30:43,962 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-03-13 10:30:43,962 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-03-13 10:30:43,962 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-03-13 10:30:43,962 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-03-13 10:30:43,962 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-03-13 10:30:43,963 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-03-13 10:30:43,963 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-03-13 10:30:43,963 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-03-13 10:30:43,963 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-03-13 10:30:43,963 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-03-13 10:30:43,963 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-03-13 10:30:43,963 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-03-13 10:30:43,964 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-03-13 10:30:43,964 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-03-13 10:30:43,964 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-03-13 10:30:43,964 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-03-13 10:30:43,964 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-03-13 10:30:43,964 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-03-13 10:30:43,964 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-03-13 10:30:43,965 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-03-13 10:30:43,965 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
2015-03-13 10:30:43,965 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-03-13 10:30:43,965 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-03-13 10:30:43,965 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-03-13 10:30:43,965 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-03-13 10:30:43,966 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-03-13 10:30:43,966 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-03-13 10:30:43,966 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-03-13 10:30:43,966 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-03-13 10:30:43,966 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-03-13 10:30:43,966 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-03-13 10:30:43,966 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-03-13 10:30:43,967 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-03-13 10:30:43,967 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-03-13 10:30:43,967 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:30:43,967 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-03-13 10:30:43,967 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-03-13 10:30:44,061 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:30:44,063 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007 src: /127.0.0.1:52501 dest: /127.0.0.1:52444
2015-03-13 10:30:44,064 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007 src: /127.0.0.1:52502 dest: /127.0.0.1:52451
2015-03-13 10:30:44,066 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007 src: /127.0.0.1:52503 dest: /127.0.0.1:52447
2015-03-13 10:30:44,077 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52503, dest: /127.0.0.1:52447, bytes: 98290, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 9870000
2015-03-13 10:30:44,078 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:44,079 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:30:44,080 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52502, dest: /127.0.0.1:52451, bytes: 98290, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 11734000
2015-03-13 10:30:44,080 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:44,081 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:30:44,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52501, dest: /127.0.0.1:52444, bytes: 98290, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 13741000
2015-03-13 10:30:44,082 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:44,082 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:30:44,085 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:30:44,085 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0001
2015-03-13 10:30:44,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001	dst=null	perm=null
2015-03-13 10:30:44,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:44,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:44,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:44,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:44,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:44,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:44,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:30:44,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:30:44,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:44,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:44,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:44,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:44,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:44,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:44,188 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 1 submitted by user soberoi
2015-03-13 10:30:44,188 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0001
2015-03-13 10:30:44,189 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from NEW to NEW_SAVING
2015-03-13 10:30:44,189 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0001
2015-03-13 10:30:44,193 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0001
2015-03-13 10:30:44,195 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:30:44,195 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0001_000001
2015-03-13 10:30:44,198 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from NEW to SUBMITTED
2015-03-13 10:30:44,202 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0001 from user: soberoi activated in queue: default
2015-03-13 10:30:44,204 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:30:44,204 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:30:44,204 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0001_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0, currently active: 1
2015-03-13 10:30:44,207 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:30:44,207 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from SUBMITTED to ACCEPTED
2015-03-13 10:30:44,209 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0001 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:30:44,231 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0001/
2015-03-13 10:30:44,232 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0001
2015-03-13 10:30:44,232 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0001/
2015-03-13 10:30:44,270 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:44,270 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000001
2015-03-13 10:30:44,270 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:30:44,270 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0001_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:44,271 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:30:44,271 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:44,272 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:44,273 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0001 AttemptId: appattempt_1426267835672_0001_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:30:44,273 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:30:44,277 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0001_000001
2015-03-13 10:30:44,278 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:30:44,280 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0001_000001
2015-03-13 10:30:44,289 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0001_000001
2015-03-13 10:30:44,289 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:30:44,307 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0001_000001 (auth:SIMPLE)
2015-03-13 10:30:44,314 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000001 by user soberoi
2015-03-13 10:30:44,324 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0001
2015-03-13 10:30:44,326 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from NEW to INITING
2015-03-13 10:30:44,326 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000001
2015-03-13 10:30:44,327 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000001 to application application_1426267835672_0001
2015-03-13 10:30:44,330 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from INITING to RUNNING
2015-03-13 10:30:44,332 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:30:44,332 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:44,335 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0001_000001
2015-03-13 10:30:44,335 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:30:44,340 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,340 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:44,341 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000001
2015-03-13 10:30:44,342 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:44,348 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:44,357 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0001_01_000001.tokens. Credentials list: 
2015-03-13 10:30:44,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:44,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:44,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:44,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:44,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:30:44,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:30:44,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:30:44,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:30:44,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:30:44,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:30:44,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:30:44,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:30:44,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:30:44,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:30:44,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:44,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:44,382 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:44,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:44,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:44,407 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52505, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 3220000
2015-03-13 10:30:44,407 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52506, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 3702000
2015-03-13 10:30:44,459 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,461 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005
2015-03-13 10:30:44,480 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007
2015-03-13 10:30:44,487 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003
2015-03-13 10:30:44,488 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006
2015-03-13 10:30:44,489 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004
2015-03-13 10:30:44,490 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005
2015-03-13 10:30:44,491 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007
2015-03-13 10:30:44,495 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0001_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001.tokens
2015-03-13 10:30:44,496 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:44,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:44,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:44,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:44,597 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52509, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_887263480_831, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 692000
2015-03-13 10:30:44,629 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:30:44,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:30:44,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:30:44,655 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52506, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_887263480_831, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 220000
2015-03-13 10:30:44,668 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:44,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:44,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:44,695 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52506, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_887263480_831, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 223000
2015-03-13 10:30:44,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:44,725 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003
2015-03-13 10:30:44,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:44,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:44,727 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004
2015-03-13 10:30:44,728 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007
2015-03-13 10:30:44,728 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005
2015-03-13 10:30:44,729 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006
2015-03-13 10:30:44,734 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52509, bytes: 99058, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_887263480_831, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 382000
2015-03-13 10:30:44,747 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:44,748 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:44,783 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:44,783 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:44,853 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001/default_container_executor.sh]
2015-03-13 10:30:44,886 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004
2015-03-13 10:30:44,887 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003
2015-03-13 10:30:44,887 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006
2015-03-13 10:30:44,887 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005
2015-03-13 10:30:45,266 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:45,268 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:45,845 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52451 to replicate blk_1073741828_1004 to datanode(s) 127.0.0.1:52447
2015-03-13 10:30:46,268 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:46,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:30:46,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:30:46,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:30:46,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:30:46,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001	dst=null	perm=null
2015-03-13 10:30:46,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:30:46,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:30:46,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:30:46,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:30:46,736 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 to 127.0.0.1:52447 
2015-03-13 10:30:46,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52511 dest: /127.0.0.1:52447
2015-03-13 10:30:46,740 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 (numBytes=254067) to /127.0.0.1:52447
2015-03-13 10:30:46,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004 src: /127.0.0.1:52511 dest: /127.0.0.1:52447 of size 254067
2015-03-13 10:30:46,742 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741828_1004 size 254067
2015-03-13 10:30:46,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:30:46,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:30:46,860 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52512, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741830_1006, duration: 248000
2015-03-13 10:30:47,269 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:47,605 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0001_000001 (auth:SIMPLE)
2015-03-13 10:30:47,610 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0001_000001
2015-03-13 10:30:47,611 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0001	APPATTEMPTID=appattempt_1426267835672_0001_000001
2015-03-13 10:30:47,612 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:30:47,612 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from ACCEPTED to RUNNING
2015-03-13 10:30:47,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:47,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:30:47,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:30:47,847 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:30:47,898 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008 src: /127.0.0.1:52518 dest: /127.0.0.1:52447
2015-03-13 10:30:47,899 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008 src: /127.0.0.1:52519 dest: /127.0.0.1:52451
2015-03-13 10:30:47,901 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008 src: /127.0.0.1:52520 dest: /127.0.0.1:52454
2015-03-13 10:30:47,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52520, dest: /127.0.0.1:52454, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, duration: 12757000
2015-03-13 10:30:47,916 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:47,917 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52519, dest: /127.0.0.1:52451, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, duration: 13085000
2015-03-13 10:30:47,918 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:47,917 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:47,919 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52518, dest: /127.0.0.1:52447, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, duration: 15287000
2015-03-13 10:30:47,919 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:47,920 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:47,920 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:30:47,925 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:30:48,275 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:49,023 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:49,023 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:49,023 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:30:49,024 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,024 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:30:49,024 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,025 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:49,026 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:49,026 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:30:49,026 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000003, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,026 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:30:49,026 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,027 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:49,027 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:49,027 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:30:49,028 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000004, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,028 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:30:49,028 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,028 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:49,029 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:49,029 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:30:49,029 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000005, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,029 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:30:49,029 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:49,276 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:49,485 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008
2015-03-13 10:30:49,488 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004
2015-03-13 10:30:49,662 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:49,663 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:49,663 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:49,664 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:30:49,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:49,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:49,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:49,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:49,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:49,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:49,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:49,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:49,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:49,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:49,735 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008
2015-03-13 10:30:49,773 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0001_000001 (auth:SIMPLE)
2015-03-13 10:30:49,777 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000005 by user soberoi
2015-03-13 10:30:49,777 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000002 by user soberoi
2015-03-13 10:30:49,777 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000003 by user soberoi
2015-03-13 10:30:49,777 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000004 by user soberoi
2015-03-13 10:30:49,779 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:49,778 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000002 to application application_1426267835672_0001
2015-03-13 10:30:49,778 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:49,778 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0001
2015-03-13 10:30:49,780 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000003 to application application_1426267835672_0001
2015-03-13 10:30:49,779 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:49,781 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000004 to application application_1426267835672_0001
2015-03-13 10:30:49,782 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from NEW to INITING
2015-03-13 10:30:49,782 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000005 to application application_1426267835672_0001
2015-03-13 10:30:49,781 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:49,783 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from INITING to RUNNING
2015-03-13 10:30:49,783 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:30:49,784 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:30:49,785 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:30:49,785 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:30:49,785 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,786 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,786 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:30:49,787 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:30:49,788 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:49,788 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:30:49,788 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:49,788 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:30:49,788 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,788 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,788 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:30:49,789 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:30:49,789 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,789 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,789 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:30:49,789 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:30:49,790 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,790 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:30:49,790 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:30:49,790 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:30:49,790 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000004
2015-03-13 10:30:49,791 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:49,794 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:49,795 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000003
2015-03-13 10:30:49,796 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:49,796 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:49,796 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000005
2015-03-13 10:30:49,797 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:49,797 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:49,797 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0001_01_000002
2015-03-13 10:30:49,798 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:30:49,798 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:30:49,815 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426267835672_0001_01_000004.tokens. Credentials list: 
2015-03-13 10:30:49,816 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0001_01_000003.tokens. Credentials list: 
2015-03-13 10:30:49,816 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426267835672_0001_01_000002.tokens. Credentials list: 
2015-03-13 10:30:49,818 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426267835672_0001_01_000005.tokens. Credentials list: 
2015-03-13 10:30:49,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:49,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:49,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:49,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:49,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:30:49,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:30:49,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:30:49,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:30:49,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:30:49,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:30:49,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:30:49,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:30:49,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:30:49,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:30:49,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:49,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:49,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:30:49,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:30:49,842 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:49,853 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52522, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 1903000
2015-03-13 10:30:49,853 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52523, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 2054000
2015-03-13 10:30:49,879 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:49,879 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:49,890 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008
2015-03-13 10:30:49,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426267835672_0001_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004.tokens
2015-03-13 10:30:49,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:49,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:49,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:49,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar	dst=null	perm=null
2015-03-13 10:30:50,002 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52523, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1260990858_967, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741828_1004, duration: 707000
2015-03-13 10:30:50,023 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,024 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,026 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,026 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,027 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:50,027 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:50,028 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:50,028 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:50,030 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:30:50,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:50,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:50,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml	dst=null	perm=null
2015-03-13 10:30:50,055 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52523, bytes: 99058, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1260990858_967, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741831_1007, duration: 372000
2015-03-13 10:30:50,069 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:30:50,069 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:50,070 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:50,070 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:50,070 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:30:50,119 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:50,120 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:50,121 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:50,121 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:50,121 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:50,121 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:50,128 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:30:50,128 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:50,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003/default_container_executor.sh]
2015-03-13 10:30:50,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005/default_container_executor.sh]
2015-03-13 10:30:50,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002/default_container_executor.sh]
2015-03-13 10:30:50,249 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004/default_container_executor.sh]
2015-03-13 10:30:50,279 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:50,679 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:30:51,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,029 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,099 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:51,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426267835672_0001_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005.tokens
2015-03-13 10:30:51,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:51,283 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:51,333 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:51,455 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426267835672_0001_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002.tokens
2015-03-13 10:30:51,455 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:51,576 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:30:51,692 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0001_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003.tokens
2015-03-13 10:30:51,692 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:30:52,037 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:52,039 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:52,039 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:52,039 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:52,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,042 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,042 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,043 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,043 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:53,291 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,046 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,046 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,047 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,047 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:54,292 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,049 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,050 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,050 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,050 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:55,294 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,055 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,055 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,055 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:56,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:57,003 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52534, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 291000
2015-03-13 10:30:57,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:57,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:57,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job.split	dst=null	perm=null
2015-03-13 10:30:57,059 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,060 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,060 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,061 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:30:57,144 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52538, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000002_0_-219719247_1, offset: 512, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 292000
2015-03-13 10:30:57,163 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52539, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000003_0_-1508680245_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 307000
2015-03-13 10:30:57,168 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52540, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000000_0_1872241169_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741829_1005, duration: 231000
2015-03-13 10:30:57,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:30:57,248 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52541, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000002_0_-219719247_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 292000
2015-03-13 10:30:57,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:30:57,263 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52542, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000003_0_-1508680245_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 214000
2015-03-13 10:30:57,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:30:57,273 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52543, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000000_0_1872241169_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1827000
2015-03-13 10:30:57,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,543 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52544, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1288000
2015-03-13 10:30:57,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary	dst=null	perm=null
2015-03-13 10:30:57,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:57,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:30:57,639 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:30:57,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_m_000002_0	dst=null	perm=null
2015-03-13 10:30:57,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009 src: /127.0.0.1:52545 dest: /127.0.0.1:52444
2015-03-13 10:30:57,687 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009 src: /127.0.0.1:52546 dest: /127.0.0.1:52447
2015-03-13 10:30:57,688 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009 src: /127.0.0.1:52547 dest: /127.0.0.1:52451
2015-03-13 10:30:57,700 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52547, dest: /127.0.0.1:52451, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 10591000
2015-03-13 10:30:57,701 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:30:57,702 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52546, dest: /127.0.0.1:52447, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 9508000
2015-03-13 10:30:57,702 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:57,703 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:57,703 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:57,704 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52545, dest: /127.0.0.1:52444, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 11354000
2015-03-13 10:30:57,704 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:30:57,705 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:30:57,710 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0001_m_000001_0_1630706361_1
2015-03-13 10:30:57,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:30:57,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:30:57,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:30:57,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:30:57,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:30:57,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_m_000003_0	dst=null	perm=null
2015-03-13 10:30:57,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:30:57,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:30:57,740 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000004
2015-03-13 10:30:57,741 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:57,741 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:30:57,741 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000004
2015-03-13 10:30:57,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,742 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,742 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:30:57,742 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0/part-m-00001-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-m-00001-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:30:57,755 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000004 is : 143
2015-03-13 10:30:57,760 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:30:57,762 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010 src: /127.0.0.1:52548 dest: /127.0.0.1:52447
2015-03-13 10:30:57,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010 src: /127.0.0.1:52549 dest: /127.0.0.1:52444
2015-03-13 10:30:57,766 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010 src: /127.0.0.1:52550 dest: /127.0.0.1:52454
2015-03-13 10:30:57,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:30:57,773 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:30:57,774 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist for DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:30:57,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004
2015-03-13 10:30:57,776 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:57,776 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004
2015-03-13 10:30:57,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004
2015-03-13 10:30:57,776 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000004
2015-03-13 10:30:57,777 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:30:57,778 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000004 from application application_1426267835672_0001
2015-03-13 10:30:57,778 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:57,778 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:30:57,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:30:57,812 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000003
2015-03-13 10:30:57,812 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:57,812 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:30:57,813 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000003
2015-03-13 10:30:57,813 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,814 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:30:57,814 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:57,814 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000004
2015-03-13 10:30:57,815 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,816 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:30:57,816 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:30:57,816 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000004
2015-03-13 10:30:57,816 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:30:57,817 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:30:57,817 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000004, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:57,817 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:57,817 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:30:57,817 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000004 on node: host: 10.1.1.144:52473 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:30:57,826 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000003 is : 143
2015-03-13 10:30:57,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_m_000000_0	dst=null	perm=null
2015-03-13 10:30:57,841 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:30:57,842 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003
2015-03-13 10:30:57,843 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003
2015-03-13 10:30:57,843 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003
2015-03-13 10:30:57,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000003
2015-03-13 10:30:57,844 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000002
2015-03-13 10:30:57,844 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:57,844 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,845 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:57,845 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,847 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:30:57,848 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:57,848 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:30:57,849 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000002
2015-03-13 10:30:57,860 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000002 is : 143
2015-03-13 10:30:57,872 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000003 from application application_1426267835672_0001
2015-03-13 10:30:57,873 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:57,873 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:30:57,873 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:30:57,874 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002
2015-03-13 10:30:57,875 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002
2015-03-13 10:30:57,878 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000005
2015-03-13 10:30:57,878 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:57,878 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:57,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:57,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000003
2015-03-13 10:30:57,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:57,880 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:30:57,880 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:30:57,880 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000003
2015-03-13 10:30:57,880 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:30:57,880 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:30:57,880 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000003, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:57,881 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:57,881 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:30:57,881 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000003 on node: host: 10.1.1.144:52473 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:30:57,884 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002
2015-03-13 10:30:57,886 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000002
2015-03-13 10:30:57,887 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:30:57,887 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:57,887 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:30:57,888 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000005
2015-03-13 10:30:57,897 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000005 is : 143
2015-03-13 10:30:57,910 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000002 from application application_1426267835672_0001
2015-03-13 10:30:57,912 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:57,912 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:30:57,913 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:30:57,913 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005
2015-03-13 10:30:57,914 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005
2015-03-13 10:30:57,915 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005
2015-03-13 10:30:57,916 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000005
2015-03-13 10:30:57,917 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:57,917 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:30:57,917 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000005 from application application_1426267835672_0001
2015-03-13 10:30:57,917 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:30:57,918 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:30:58,308 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:58,884 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:58,884 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000002
2015-03-13 10:30:58,885 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:30:58,885 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000005
2015-03-13 10:30:58,886 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:30:58,886 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:30:58,886 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000002
2015-03-13 10:30:58,886 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:30:58,887 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:30:58,887 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:58,887 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:58,887 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:30:58,888 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000002 on node: host: 10.1.1.144:52473 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:30:58,888 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:30:58,888 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:30:58,888 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000005
2015-03-13 10:30:58,888 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:30:58,889 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:30:58,889 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000005, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:58,889 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:58,889 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:30:58,889 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000005 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:30:59,309 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:30:59,500 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009
2015-03-13 10:30:59,501 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009
2015-03-13 10:30:59,744 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009
2015-03-13 10:30:59,890 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:30:59,891 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:30:59,891 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:30:59,891 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0001 container=Container: [ContainerId: container_1426267835672_0001_01_000006, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0001_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:30:59,891 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:30:59,892 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:00,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:00,721 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:00,729 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0001_01_000006 by user soberoi
2015-03-13 10:31:00,730 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:31:00,730 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0001_01_000006 to application application_1426267835672_0001
2015-03-13 10:31:00,730 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:31:00,730 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0001
2015-03-13 10:31:00,730 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0001
2015-03-13 10:31:00,731 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:00,731 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0001
2015-03-13 10:31:00,732 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:00,756 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:00,757 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:00,824 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006/default_container_executor.sh]
2015-03-13 10:31:00,890 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:00,890 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:01,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:01,729 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:31:01,894 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:02,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:02,897 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:03,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:03,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:03,335 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:03,401 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011 src: /127.0.0.1:52555 dest: /127.0.0.1:52451
2015-03-13 10:31:03,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011 src: /127.0.0.1:52556 dest: /127.0.0.1:52454
2015-03-13 10:31:03,405 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011 src: /127.0.0.1:52557 dest: /127.0.0.1:52444
2015-03-13 10:31:03,418 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52557, dest: /127.0.0.1:52444, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 11563000
2015-03-13 10:31:03,418 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,419 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:03,419 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52556, dest: /127.0.0.1:52454, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 12258000
2015-03-13 10:31:03,419 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,420 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:03,420 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52555, dest: /127.0.0.1:52451, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 13257000
2015-03-13 10:31:03,420 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,421 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:03,424 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1
2015-03-13 10:31:03,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0	dst=null	perm=null
2015-03-13 10:31:03,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0	dst=null	perm=null
2015-03-13 10:31:03,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0	dst=null	perm=null
2015-03-13 10:31:03,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0	dst=null	perm=null
2015-03-13 10:31:03,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0	dst=null	perm=null
2015-03-13 10:31:03,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:03,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:31:03,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0/part-r-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0001_r_000000_0	dst=null	perm=null
2015-03-13 10:31:03,455 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:03,459 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012 src: /127.0.0.1:52558 dest: /127.0.0.1:52444
2015-03-13 10:31:03,462 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012 src: /127.0.0.1:52559 dest: /127.0.0.1:52454
2015-03-13 10:31:03,463 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012 src: /127.0.0.1:52560 dest: /127.0.0.1:52447
2015-03-13 10:31:03,469 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52560, dest: /127.0.0.1:52447, bytes: 294, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, duration: 4034000
2015-03-13 10:31:03,469 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,470 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,470 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52559, dest: /127.0.0.1:52454, bytes: 294, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, duration: 4526000
2015-03-13 10:31:03,471 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,472 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,472 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52558, dest: /127.0.0.1:52444, bytes: 294, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, duration: 6388000
2015-03-13 10:31:03,472 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,473 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,475 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0001_r_000000_0_-1353725862_1
2015-03-13 10:31:03,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0	dst=null	perm=null
2015-03-13 10:31:03,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0	dst=null	perm=null
2015-03-13 10:31:03,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/task_1426267835672_0001_r_000000	dst=null	perm=null
2015-03-13 10:31:03,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/_temporary/attempt_1426267835672_0001_r_000000_0	dst=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/task_1426267835672_0001_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:03,496 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000006
2015-03-13 10:31:03,496 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:31:03,496 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:31:03,497 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000006
2015-03-13 10:31:03,497 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:03,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,506 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,509 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0001_01_000006 is : 143
2015-03-13 10:31:03,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1	dst=null	perm=null
2015-03-13 10:31:03,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335	dst=null	perm=null
2015-03-13 10:31:03,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335	dst=null	perm=null
2015-03-13 10:31:03,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/task_1426267835672_0001_r_000000	dst=null	perm=null
2015-03-13 10:31:03,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/part-00000	dst=null	perm=null
2015-03-13 10:31:03,525 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:03,526 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006
2015-03-13 10:31:03,526 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006
2015-03-13 10:31:03,526 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006
2015-03-13 10:31:03,527 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000006
2015-03-13 10:31:03,526 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:31:03,527 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:03,527 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000006 from application application_1426267835672_0001
2015-03-13 10:31:03,527 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:03,527 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:31:03,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary/1/task_1426267835672_0001_r_000000/part-00000	dst=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_temporary	dst=null	perm=null
2015-03-13 10:31:03,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,539 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,542 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,556 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52550, dest: /127.0.0.1:52454, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, duration: 5787960000
2015-03-13 10:31:03,556 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,557 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,557 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52549, dest: /127.0.0.1:52444, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, duration: 5789108000
2015-03-13 10:31:03,558 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,559 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,559 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52548, dest: /127.0.0.1:52447, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, duration: 5790653000
2015-03-13 10:31:03,559 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,560 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,561 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,566 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:03,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013 src: /127.0.0.1:52561 dest: /127.0.0.1:52454
2015-03-13 10:31:03,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013 src: /127.0.0.1:52562 dest: /127.0.0.1:52444
2015-03-13 10:31:03,572 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013 src: /127.0.0.1:52563 dest: /127.0.0.1:52447
2015-03-13 10:31:03,575 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52563, dest: /127.0.0.1:52447, bytes: 424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, duration: 1943000
2015-03-13 10:31:03,575 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,576 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,576 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52562, dest: /127.0.0.1:52444, bytes: 424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, duration: 2629000
2015-03-13 10:31:03,576 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,577 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,577 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52561, dest: /127.0.0.1:52454, bytes: 424, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, duration: 3808000
2015-03-13 10:31:03,578 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,578 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,581 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist	dst=null	perm=null
2015-03-13 10:31:03,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:31:03,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist	dst=null	perm=null
2015-03-13 10:31:03,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:31:03,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1.jhist	dst=null	perm=null
2015-03-13 10:31:03,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,601 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52564, bytes: 60868, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010, duration: 219000
2015-03-13 10:31:03,603 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:03,605 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014 src: /127.0.0.1:52565 dest: /127.0.0.1:52451
2015-03-13 10:31:03,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014 src: /127.0.0.1:52566 dest: /127.0.0.1:52454
2015-03-13 10:31:03,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014 src: /127.0.0.1:52567 dest: /127.0.0.1:52447
2015-03-13 10:31:03,613 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52567, dest: /127.0.0.1:52447, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, duration: 2394000
2015-03-13 10:31:03,613 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,614 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52566, dest: /127.0.0.1:52454, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, duration: 3018000
2015-03-13 10:31:03,614 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,615 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,615 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52565, dest: /127.0.0.1:52451, bytes: 60396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, duration: 4371000
2015-03-13 10:31:03,615 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,616 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:03,617 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:03,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:31:03,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:03,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:31:03,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001/job_1426267835672_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:03,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:03,633 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52564, bytes: 91714, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741832_1008, duration: 510000
2015-03-13 10:31:03,635 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:03,637 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015 src: /127.0.0.1:52568 dest: /127.0.0.1:52451
2015-03-13 10:31:03,638 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015 src: /127.0.0.1:52569 dest: /127.0.0.1:52444
2015-03-13 10:31:03,640 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015 src: /127.0.0.1:52570 dest: /127.0.0.1:52454
2015-03-13 10:31:03,645 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52570, dest: /127.0.0.1:52454, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, duration: 3972000
2015-03-13 10:31:03,645 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:03,646 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,646 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52569, dest: /127.0.0.1:52444, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, duration: 4774000
2015-03-13 10:31:03,646 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,647 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,647 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52568, dest: /127.0.0.1:52451, bytes: 91002, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1549438670_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, duration: 5789000
2015-03-13 10:31:03,647 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:03,648 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:03,650 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1549438670_1
2015-03-13 10:31:03,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:03,669 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from RUNNING to FINISHING
2015-03-13 10:31:03,670 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0001
2015-03-13 10:31:03,670 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from RUNNING to REMOVING
2015-03-13 10:31:03,670 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0001
2015-03-13 10:31:03,672 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from REMOVING to FINISHING
2015-03-13 10:31:04,318 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:04,501 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:04,501 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000006
2015-03-13 10:31:04,502 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:04,502 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:31:04,502 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000006
2015-03-13 10:31:04,503 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:04,503 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:04,503 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000006, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:04,503 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:04,504 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:04,504 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000006 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:04,505 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012
2015-03-13 10:31:04,507 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011
2015-03-13 10:31:04,507 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010
2015-03-13 10:31:04,508 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010
2015-03-13 10:31:04,508 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013
2015-03-13 10:31:04,508 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012
2015-03-13 10:31:04,509 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013
2015-03-13 10:31:04,509 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014
2015-03-13 10:31:04,510 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015
2015-03-13 10:31:04,685 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741828_1004 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52447 
2015-03-13 10:31:04,685 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52451 
2015-03-13 10:31:04,685 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52451 
2015-03-13 10:31:04,685 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52447 
2015-03-13 10:31:04,686 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741834_1010 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:31:04,686 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52454 
2015-03-13 10:31:04,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0001	dst=null	perm=null
2015-03-13 10:31:04,750 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014
2015-03-13 10:31:04,751 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011
2015-03-13 10:31:04,751 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015
2015-03-13 10:31:04,752 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (2/2) ...atform/eacheverychain/tap
2015-03-13 10:31:04,762 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:04,773 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:04,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:04,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:04,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:04,782 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 2
2015-03-13 10:31:04,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002	dst=null	perm=null
2015-03-13 10:31:04,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:31:04,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:31:04,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:04,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,791 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:04,792 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52573 dest: /127.0.0.1:52447
2015-03-13 10:31:04,793 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52574 dest: /127.0.0.1:52451
2015-03-13 10:31:04,794 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52575 dest: /127.0.0.1:52444
2015-03-13 10:31:04,799 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52575, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 2883000
2015-03-13 10:31:04,799 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:04,799 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,800 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52574, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 3414000
2015-03-13 10:31:04,800 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,800 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,801 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52573, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 4145000
2015-03-13 10:31:04,801 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,802 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,803 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:04,804 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar
2015-03-13 10:31:04,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:04,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:04,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:04,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:04,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:31:04,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:31:04,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:31:04,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:31:04,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:31:04,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:04,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335	dst=null	perm=null
2015-03-13 10:31:04,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335	dst=null	perm=null
2015-03-13 10:31:04,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335	dst=null	perm=null
2015-03-13 10:31:04,822 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:04,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,827 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split
2015-03-13 10:31:04,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=null
2015-03-13 10:31:04,828 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:04,830 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017 src: /127.0.0.1:52576 dest: /127.0.0.1:52451
2015-03-13 10:31:04,832 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017 src: /127.0.0.1:52577 dest: /127.0.0.1:52454
2015-03-13 10:31:04,833 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017 src: /127.0.0.1:52578 dest: /127.0.0.1:52444
2015-03-13 10:31:04,834 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017 src: /127.0.0.1:52579 dest: /127.0.0.1:52447
2015-03-13 10:31:04,838 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52579, dest: /127.0.0.1:52447, bytes: 350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 2247000
2015-03-13 10:31:04,838 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:04,838 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:04,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52578, dest: /127.0.0.1:52444, bytes: 350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 2791000
2015-03-13 10:31:04,839 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,839 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:04,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52577, dest: /127.0.0.1:52454, bytes: 350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 3488000
2015-03-13 10:31:04,840 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,840 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:04,840 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52576, dest: /127.0.0.1:52451, bytes: 350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 4742000
2015-03-13 10:31:04,841 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,841 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:04,843 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:04,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,848 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:04,849 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018 src: /127.0.0.1:52580 dest: /127.0.0.1:52454
2015-03-13 10:31:04,850 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018 src: /127.0.0.1:52581 dest: /127.0.0.1:52447
2015-03-13 10:31:04,851 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018 src: /127.0.0.1:52582 dest: /127.0.0.1:52444
2015-03-13 10:31:04,854 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52582, dest: /127.0.0.1:52444, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 1683000
2015-03-13 10:31:04,854 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:04,855 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52581, dest: /127.0.0.1:52447, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 2270000
2015-03-13 10:31:04,855 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,856 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,856 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52580, dest: /127.0.0.1:52454, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 3205000
2015-03-13 10:31:04,856 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,857 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,858 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:04,859 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-03-13 10:31:04,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:04,867 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:04,867 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:04,868 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:04,894 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:04,895 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019 src: /127.0.0.1:52583 dest: /127.0.0.1:52447
2015-03-13 10:31:04,896 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741839_1015
2015-03-13 10:31:04,897 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741838_1014
2015-03-13 10:31:04,897 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019 src: /127.0.0.1:52584 dest: /127.0.0.1:52451
2015-03-13 10:31:04,897 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011
2015-03-13 10:31:04,898 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013
2015-03-13 10:31:04,898 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018
2015-03-13 10:31:04,899 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012
2015-03-13 10:31:04,899 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019 src: /127.0.0.1:52585 dest: /127.0.0.1:52444
2015-03-13 10:31:04,899 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741834_1010
2015-03-13 10:31:04,900 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017
2015-03-13 10:31:04,908 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52585, dest: /127.0.0.1:52444, bytes: 98524, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 7490000
2015-03-13 10:31:04,909 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:04,909 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,910 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52584, dest: /127.0.0.1:52451, bytes: 98524, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 8230000
2015-03-13 10:31:04,910 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,911 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,911 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52583, dest: /127.0.0.1:52447, bytes: 98524, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 9567000
2015-03-13 10:31:04,911 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:04,911 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:04,914 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:04,915 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0002
2015-03-13 10:31:04,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002	dst=null	perm=null
2015-03-13 10:31:04,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:04,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:04,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:04,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:04,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=null
2015-03-13 10:31:04,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=null
2015-03-13 10:31:04,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:04,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:04,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:04,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:04,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:04,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:04,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:04,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:04,938 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 2 submitted by user soberoi
2015-03-13 10:31:04,938 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0002
2015-03-13 10:31:04,938 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0002
2015-03-13 10:31:04,938 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0002
2015-03-13 10:31:04,938 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from NEW to NEW_SAVING
2015-03-13 10:31:04,939 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:31:04,939 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0002_000001
2015-03-13 10:31:04,939 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from NEW to SUBMITTED
2015-03-13 10:31:04,940 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0002 from user: soberoi activated in queue: default
2015-03-13 10:31:04,940 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0002 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:31:04,940 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0002 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:31:04,940 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0002_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:31:04,941 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0002 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:04,941 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:31:04,941 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from SUBMITTED to ACCEPTED
2015-03-13 10:31:04,943 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0002/
2015-03-13 10:31:04,944 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0002
2015-03-13 10:31:04,944 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0002/
2015-03-13 10:31:05,162 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:05,162 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000001
2015-03-13 10:31:05,163 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:31:05,163 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0002 container=Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0002_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:05,164 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:31:05,165 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:05,165 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:05,166 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0002 AttemptId: appattempt_1426267835672_0002_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:31:05,166 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:31:05,166 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0002_000001
2015-03-13 10:31:05,166 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:31:05,167 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0002_000001
2015-03-13 10:31:05,168 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0002_000001
2015-03-13 10:31:05,168 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0002_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:31:05,172 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:05,175 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0002_01_000001 by user soberoi
2015-03-13 10:31:05,176 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0002
2015-03-13 10:31:05,176 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000001
2015-03-13 10:31:05,177 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from NEW to INITING
2015-03-13 10:31:05,178 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0002_01_000001 to application application_1426267835672_0002
2015-03-13 10:31:05,178 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0002_000001
2015-03-13 10:31:05,178 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from INITING to RUNNING
2015-03-13 10:31:05,179 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:31:05,179 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:31:05,179 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0002
2015-03-13 10:31:05,179 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,179 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:05,180 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0002_01_000001
2015-03-13 10:31:05,181 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:31:05,183 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:31:05,194 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0002_01_000001.tokens. Credentials list: 
2015-03-13 10:31:05,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:05,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:05,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:05,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:05,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:31:05,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:31:05,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:31:05,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:31:05,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:31:05,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:31:05,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:31:05,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:31:05,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:31:05,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:31:05,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:05,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:05,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:05,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:05,216 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:05,225 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52587, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 1280000
2015-03-13 10:31:05,225 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52588, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 1470000
2015-03-13 10:31:05,248 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,249 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,313 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0002_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001.tokens
2015-03-13 10:31:05,314 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:05,320 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:05,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:05,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:05,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:05,385 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52591, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1466484916_1361, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 512000
2015-03-13 10:31:05,404 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:05,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:05,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:05,431 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52587, bytes: 49, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1466484916_1361, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 215000
2015-03-13 10:31:05,444 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=null
2015-03-13 10:31:05,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=null
2015-03-13 10:31:05,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=null
2015-03-13 10:31:05,469 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52591, bytes: 354, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1466484916_1361, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 226000
2015-03-13 10:31:05,482 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:05,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:05,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:05,506 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52588, bytes: 99296, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1466484916_1361, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 383000
2015-03-13 10:31:05,519 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:05,519 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:05,546 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:05,546 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:05,611 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001/default_container_executor.sh]
2015-03-13 10:31:06,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:06,165 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:06,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:06,867 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741840_1016 to datanode(s) 127.0.0.1:52454
2015-03-13 10:31:06,867 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741832_1008, blk_1073741834_1010]
2015-03-13 10:31:06,867 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741831_1007, blk_1073741832_1008, blk_1073741834_1010]
2015-03-13 10:31:07,168 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:07,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:07,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:31:07,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:31:07,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:31:07,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002	dst=null	perm=null
2015-03-13 10:31:07,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:31:07,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:31:07,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:07,538 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 to 127.0.0.1:52454 
2015-03-13 10:31:07,539 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828 for deletion
2015-03-13 10:31:07,540 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829 for deletion
2015-03-13 10:31:07,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52593 dest: /127.0.0.1:52454
2015-03-13 10:31:07,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828
2015-03-13 10:31:07,541 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:31:07,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829
2015-03-13 10:31:07,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831 for deletion
2015-03-13 10:31:07,542 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832 for deletion
2015-03-13 10:31:07,564 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834 for deletion
2015-03-13 10:31:07,564 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831
2015-03-13 10:31:07,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832
2015-03-13 10:31:07,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834
2015-03-13 10:31:07,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016 src: /127.0.0.1:52593 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:31:07,566 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741840_1016 size 254067
2015-03-13 10:31:07,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:07,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:07,656 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52594, bytes: 49, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018, duration: 227000
2015-03-13 10:31:07,911 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828 for deletion
2015-03-13 10:31:07,912 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829 for deletion
2015-03-13 10:31:07,912 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828
2015-03-13 10:31:07,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830 for deletion
2015-03-13 10:31:07,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832 for deletion
2015-03-13 10:31:07,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829
2015-03-13 10:31:07,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832
2015-03-13 10:31:07,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830
2015-03-13 10:31:07,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834 for deletion
2015-03-13 10:31:07,914 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834
2015-03-13 10:31:08,171 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:08,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:08,409 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:08,414 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0002_000001
2015-03-13 10:31:08,414 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0002	APPATTEMPTID=appattempt_1426267835672_0002_000001
2015-03-13 10:31:08,414 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:31:08,415 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from ACCEPTED to RUNNING
2015-03-13 10:31:08,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:08,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:08,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:08,660 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:08,705 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020 src: /127.0.0.1:52600 dest: /127.0.0.1:52444
2015-03-13 10:31:08,707 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020 src: /127.0.0.1:52601 dest: /127.0.0.1:52454
2015-03-13 10:31:08,709 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020 src: /127.0.0.1:52602 dest: /127.0.0.1:52451
2015-03-13 10:31:08,719 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52602, dest: /127.0.0.1:52451, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, duration: 7063000
2015-03-13 10:31:08,719 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:08,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52601, dest: /127.0.0.1:52454, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, duration: 7871000
2015-03-13 10:31:08,720 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:08,720 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:08,721 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52600, dest: /127.0.0.1:52444, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, duration: 9535000
2015-03-13 10:31:08,722 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:08,722 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:08,723 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:08,727 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:09,175 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:09,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:09,512 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019
2015-03-13 10:31:09,513 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018
2015-03-13 10:31:09,515 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016
2015-03-13 10:31:09,515 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017
2015-03-13 10:31:09,516 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:09,516 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:09,517 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:09,517 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0002 container=Container: [ContainerId: container_1426267835672_0002_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0002_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:09,517 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:31:09,517 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:09,517 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020
2015-03-13 10:31:09,520 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016
2015-03-13 10:31:09,521 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019
2015-03-13 10:31:09,521 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741842_1018
2015-03-13 10:31:09,522 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017
2015-03-13 10:31:09,761 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016
2015-03-13 10:31:09,762 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017
2015-03-13 10:31:09,763 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019
2015-03-13 10:31:09,763 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020
2015-03-13 10:31:09,819 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0001_01_000001 succeeded 
2015-03-13 10:31:09,819 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:31:09,819 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0001_01_000001
2015-03-13 10:31:09,827 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001
2015-03-13 10:31:09,828 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001
2015-03-13 10:31:09,828 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001
2015-03-13 10:31:09,829 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0001/container_1426267835672_0001_01_000001
2015-03-13 10:31:09,829 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000001
2015-03-13 10:31:09,829 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:31:09,830 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0001_01_000001 from application application_1426267835672_0001
2015-03-13 10:31:09,830 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:09,830 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0001
2015-03-13 10:31:09,868 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741834_1010]
2015-03-13 10:31:09,868 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741828_1004, blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008]
2015-03-13 10:31:09,907 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020
2015-03-13 10:31:09,909 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016
2015-03-13 10:31:10,181 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:10,337 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:31:10,337 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0001_01_000001
2015-03-13 10:31:10,338 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0001_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:10,338 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0001_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:31:10,338 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0001_000001
2015-03-13 10:31:10,338 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0001	CONTAINERID=container_1426267835672_0001_01_000001
2015-03-13 10:31:10,338 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:10,338 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:31:10,339 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0001_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:10,339 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:10,339 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:31:10,339 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0001_000001 released container container_1426267835672_0001_01_000001 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:10,339 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0001_000001 State change from FINISHING to FINISHED
2015-03-13 10:31:10,340 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0001 State change from FINISHING to FINISHED
2015-03-13 10:31:10,341 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0001_000001 is done. finalState=FINISHED
2015-03-13 10:31:10,341 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0001_000001
2015-03-13 10:31:10,342 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0001
2015-03-13 10:31:10,341 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0001 requests cleared
2015-03-13 10:31:10,342 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0001 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:31:10,342 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:31:10,343 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0001,name=[61C1702FCC0A429FBD628FD813F0535B/26757E2D2BB340BFA59A7DCBA8B66383] trap test/(1/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0001/jobhistory/job/job_1426267835672_0001,appMasterHost=Edinburgh.local,startTime=1426267844187,finishTime=1426267863672,finalStatus=SUCCEEDED
2015-03-13 10:31:10,344 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0001_000001 (auth:SIMPLE)
2015-03-13 10:31:10,348 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0001_01_000001
2015-03-13 10:31:10,451 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:10,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:10,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:10,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:10,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:10,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:10,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:10,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:10,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:10,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:10,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:10,522 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:10,523 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:10,523 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0001
2015-03-13 10:31:10,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:10,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:10,524 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:10,525 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0001, with delay of 10800 seconds
2015-03-13 10:31:10,525 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:10,540 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828 for deletion
2015-03-13 10:31:10,540 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829 for deletion
2015-03-13 10:31:10,540 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828
2015-03-13 10:31:10,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830 for deletion
2015-03-13 10:31:10,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829
2015-03-13 10:31:10,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831 for deletion
2015-03-13 10:31:10,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830
2015-03-13 10:31:10,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834 for deletion
2015-03-13 10:31:10,541 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831
2015-03-13 10:31:10,542 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741834_1010 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741834
2015-03-13 10:31:10,567 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:10,570 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0002_01_000002 by user soberoi
2015-03-13 10:31:10,570 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0002
2015-03-13 10:31:10,570 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:10,570 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from NEW to INITING
2015-03-13 10:31:10,570 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0002_01_000002 to application application_1426267835672_0002
2015-03-13 10:31:10,571 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from INITING to RUNNING
2015-03-13 10:31:10,571 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:31:10,571 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0002
2015-03-13 10:31:10,571 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0002
2015-03-13 10:31:10,571 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:10,571 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0002
2015-03-13 10:31:10,572 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:10,572 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:10,572 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0002_01_000002
2015-03-13 10:31:10,582 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0002_01_000002.tokens. Credentials list: 
2015-03-13 10:31:10,597 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:10,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0002_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002.tokens
2015-03-13 10:31:10,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:10,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:10,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:10,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:10,738 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52607, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1224896389_1477, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 577000
2015-03-13 10:31:10,756 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:10,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828 for deletion
2015-03-13 10:31:10,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829 for deletion
2015-03-13 10:31:10,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741828_1004 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741828
2015-03-13 10:31:10,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830 for deletion
2015-03-13 10:31:10,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831 for deletion
2015-03-13 10:31:10,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832 for deletion
2015-03-13 10:31:10,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741829
2015-03-13 10:31:10,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741830
2015-03-13 10:31:10,761 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741831
2015-03-13 10:31:10,761 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741832
2015-03-13 10:31:10,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:10,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:10,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:10,782 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52607, bytes: 99296, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1224896389_1477, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 330000
2015-03-13 10:31:10,795 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:10,795 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:10,824 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:10,824 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:10,891 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002/default_container_executor.sh]
2015-03-13 10:31:11,184 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:11,339 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:11,340 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0001
2015-03-13 10:31:11,340 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:11,340 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:11,341 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:11,340 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:11,341 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0001
2015-03-13 10:31:11,341 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0001, with delay of 10800 seconds
2015-03-13 10:31:11,465 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:31:11,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:11,525 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:12,040 INFO  hs.JobHistory (JobHistory.java:run(188)) - History Cleaner started
2015-03-13 10:31:12,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null
2015-03-13 10:31:12,042 INFO  hs.JobHistory (JobHistory.java:run(194)) - History Cleaner complete
2015-03-13 10:31:12,186 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:12,531 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:12,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.split	dst=null	perm=null
2015-03-13 10:31:12,969 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52610, bytes: 354, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0002_m_000000_0_-1766763401_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741841_1017, duration: 211000
2015-03-13 10:31:13,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/part-00000	dst=null	perm=null
2015-03-13 10:31:13,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335/part-00000	dst=null	perm=null
2015-03-13 10:31:13,026 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52611, bytes: 298, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0002_m_000000_0_-1766763401_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741836_1012, duration: 224000
2015-03-13 10:31:13,190 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:13,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_m_000000_0	dst=null	perm=null
2015-03-13 10:31:13,378 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0002_01_000002
2015-03-13 10:31:13,378 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:13,378 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:31:13,378 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0002_01_000002
2015-03-13 10:31:13,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:13,387 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0002_01_000002 is : 143
2015-03-13 10:31:13,392 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:13,393 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021 src: /127.0.0.1:52612 dest: /127.0.0.1:52451
2015-03-13 10:31:13,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021 src: /127.0.0.1:52613 dest: /127.0.0.1:52454
2015-03-13 10:31:13,396 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021 src: /127.0.0.1:52614 dest: /127.0.0.1:52444
2015-03-13 10:31:13,399 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:13,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002
2015-03-13 10:31:13,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002
2015-03-13 10:31:13,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002
2015-03-13 10:31:13,399 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:13,399 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:13,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000002
2015-03-13 10:31:13,400 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0002_01_000002 from application application_1426267835672_0002
2015-03-13 10:31:13,400 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:13,400 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0002
2015-03-13 10:31:13,401 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist for DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:14,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:14,379 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:14,380 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0002_01_000002
2015-03-13 10:31:14,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:14,380 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0002_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:31:14,381 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000002
2015-03-13 10:31:14,381 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:14,381 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:14,381 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0002_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:14,381 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:14,382 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:14,382 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0002_000001 released container container_1426267835672_0002_01_000002 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:14,620 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:14,620 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:14,620 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:14,621 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0002 container=Container: [ContainerId: container_1426267835672_0002_01_000003, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0002_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:14,621 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:14,621 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:15,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:15,486 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:15,498 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:15,501 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0002_01_000003 by user soberoi
2015-03-13 10:31:15,502 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0002
2015-03-13 10:31:15,502 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:15,503 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from NEW to INITING
2015-03-13 10:31:15,504 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0002_01_000003 to application application_1426267835672_0002
2015-03-13 10:31:15,504 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from INITING to RUNNING
2015-03-13 10:31:15,505 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:31:15,505 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0002
2015-03-13 10:31:15,505 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0002
2015-03-13 10:31:15,505 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:15,505 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0002
2015-03-13 10:31:15,505 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:15,505 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:15,505 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:15,506 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:15,506 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0002_01_000003
2015-03-13 10:31:15,506 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426267835237, FILE, null }
2015-03-13 10:31:15,508 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar, 1426267835358, FILE, null }
2015-03-13 10:31:15,519 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426267835672_0002_01_000003.tokens. Credentials list: 
2015-03-13 10:31:15,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:15,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:15,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:15,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:15,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:31:15,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:31:15,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:31:15,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:31:15,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:31:15,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:31:15,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:31:15,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:31:15,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:31:15,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:31:15,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:15,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:15,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:15,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:15,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:15,548 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52617, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741826_1002, duration: 1114000
2015-03-13 10:31:15,548 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52618, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741825_1001, duration: 1206000
2015-03-13 10:31:15,574 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:15,577 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:15,621 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:15,621 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:15,644 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426267835672_0002_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003.tokens
2015-03-13 10:31:15,644 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:15,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:15,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:15,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar	dst=null	perm=null
2015-03-13 10:31:15,721 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52618, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1001803561_1589, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741840_1016, duration: 459000
2015-03-13 10:31:15,742 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:15,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:15,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:15,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml	dst=null	perm=null
2015-03-13 10:31:15,767 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52617, bytes: 99296, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1001803561_1589, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741843_1019, duration: 329000
2015-03-13 10:31:15,780 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:15,780 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:15,807 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:15,807 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:15,875 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003/default_container_executor.sh]
2015-03-13 10:31:16,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:16,493 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:31:16,625 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:17,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:17,627 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:18,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:18,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:18,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,221 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:18,277 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022 src: /127.0.0.1:52624 dest: /127.0.0.1:52454
2015-03-13 10:31:18,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022 src: /127.0.0.1:52625 dest: /127.0.0.1:52444
2015-03-13 10:31:18,280 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022 src: /127.0.0.1:52626 dest: /127.0.0.1:52447
2015-03-13 10:31:18,290 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52626, dest: /127.0.0.1:52447, bytes: 27, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 8589000
2015-03-13 10:31:18,291 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,292 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,292 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52625, dest: /127.0.0.1:52444, bytes: 27, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 10299000
2015-03-13 10:31:18,292 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,292 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,293 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52624, dest: /127.0.0.1:52454, bytes: 27, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 11187000
2015-03-13 10:31:18,293 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,293 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,296 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000 is closed by DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1
2015-03-13 10:31:18,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0	dst=null	perm=null
2015-03-13 10:31:18,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0	dst=null	perm=null
2015-03-13 10:31:18,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0	dst=null	perm=null
2015-03-13 10:31:18,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0	dst=null	perm=null
2015-03-13 10:31:18,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0	dst=null	perm=null
2015-03-13 10:31:18,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:18,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000	dst=null	perm=null
2015-03-13 10:31:18,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0/part-r-00002-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00002-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary/_attempt_1426267835672_0002_r_000000_0	dst=null	perm=null
2015-03-13 10:31:18,330 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:18,333 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023 src: /127.0.0.1:52627 dest: /127.0.0.1:52454
2015-03-13 10:31:18,335 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023 src: /127.0.0.1:52628 dest: /127.0.0.1:52451
2015-03-13 10:31:18,338 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023 src: /127.0.0.1:52629 dest: /127.0.0.1:52444
2015-03-13 10:31:18,341 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52629, dest: /127.0.0.1:52444, bytes: 85, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 1800000
2015-03-13 10:31:18,341 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,342 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,342 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52628, dest: /127.0.0.1:52451, bytes: 85, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 2393000
2015-03-13 10:31:18,342 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,342 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,343 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52627, dest: /127.0.0.1:52454, bytes: 85, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 3530000
2015-03-13 10:31:18,343 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,344 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,345 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0002_r_000000_0_-1481566194_1
2015-03-13 10:31:18,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0	dst=null	perm=null
2015-03-13 10:31:18,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0	dst=null	perm=null
2015-03-13 10:31:18,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/task_1426267835672_0002_r_000000	dst=null	perm=null
2015-03-13 10:31:18,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/_temporary/attempt_1426267835672_0002_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/task_1426267835672_0002_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:18,365 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0002_01_000003
2015-03-13 10:31:18,365 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:18,365 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:31:18,366 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0002_01_000003
2015-03-13 10:31:18,366 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:18,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,374 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,378 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0002_01_000003 is : 143
2015-03-13 10:31:18,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1	dst=null	perm=null
2015-03-13 10:31:18,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:18,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:18,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/task_1426267835672_0002_r_000000	dst=null	perm=null
2015-03-13 10:31:18,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:18,392 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:18,393 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003
2015-03-13 10:31:18,394 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003
2015-03-13 10:31:18,394 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:18,395 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003
2015-03-13 10:31:18,395 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000003
2015-03-13 10:31:18,399 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:18,399 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0002_01_000003 from application application_1426267835672_0002
2015-03-13 10:31:18,399 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:18,399 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0002
2015-03-13 10:31:18,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary/1/task_1426267835672_0002_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary	dst=null	perm=null
2015-03-13 10:31:18,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,412 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,416 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,429 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52614, dest: /127.0.0.1:52444, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, duration: 5031285000
2015-03-13 10:31:18,429 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,430 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,430 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52613, dest: /127.0.0.1:52454, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, duration: 5032187000
2015-03-13 10:31:18,430 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,431 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,431 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52612, dest: /127.0.0.1:52451, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, duration: 5033671000
2015-03-13 10:31:18,431 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,432 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:18,433 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,437 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:18,439 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024 src: /127.0.0.1:52630 dest: /127.0.0.1:52447
2015-03-13 10:31:18,441 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024 src: /127.0.0.1:52631 dest: /127.0.0.1:52444
2015-03-13 10:31:18,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024 src: /127.0.0.1:52632 dest: /127.0.0.1:52454
2015-03-13 10:31:18,444 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52632, dest: /127.0.0.1:52454, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, duration: 1565000
2015-03-13 10:31:18,445 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,445 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,445 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52631, dest: /127.0.0.1:52444, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, duration: 2229000
2015-03-13 10:31:18,446 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,446 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52630, dest: /127.0.0.1:52447, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, duration: 3114000
2015-03-13 10:31:18,446 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,447 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,448 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist	dst=null	perm=null
2015-03-13 10:31:18,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:31:18,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist	dst=null	perm=null
2015-03-13 10:31:18,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:31:18,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1.jhist	dst=null	perm=null
2015-03-13 10:31:18,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,468 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52633, bytes: 37222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021, duration: 226000
2015-03-13 10:31:18,470 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:18,472 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025 src: /127.0.0.1:52634 dest: /127.0.0.1:52447
2015-03-13 10:31:18,474 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025 src: /127.0.0.1:52635 dest: /127.0.0.1:52444
2015-03-13 10:31:18,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025 src: /127.0.0.1:52636 dest: /127.0.0.1:52454
2015-03-13 10:31:18,480 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52636, dest: /127.0.0.1:52454, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, duration: 1676000
2015-03-13 10:31:18,480 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,481 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,481 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52635, dest: /127.0.0.1:52444, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, duration: 2430000
2015-03-13 10:31:18,481 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,482 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,482 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52634, dest: /127.0.0.1:52447, bytes: 36930, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, duration: 3512000
2015-03-13 10:31:18,482 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,482 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:18,484 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:18,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:31:18,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:18,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:31:18,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002/job_1426267835672_0002_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:18,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:18,495 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52633, bytes: 91862, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741844_1020, duration: 338000
2015-03-13 10:31:18,496 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:18,498 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026 src: /127.0.0.1:52637 dest: /127.0.0.1:52454
2015-03-13 10:31:18,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026 src: /127.0.0.1:52638 dest: /127.0.0.1:52451
2015-03-13 10:31:18,500 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026 src: /127.0.0.1:52639 dest: /127.0.0.1:52447
2015-03-13 10:31:18,505 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52639, dest: /127.0.0.1:52447, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, duration: 3197000
2015-03-13 10:31:18,505 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:18,505 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,506 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52638, dest: /127.0.0.1:52451, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, duration: 3715000
2015-03-13 10:31:18,506 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,506 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,507 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52637, dest: /127.0.0.1:52454, bytes: 91146, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1438721047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, duration: 4759000
2015-03-13 10:31:18,507 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:18,507 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:18,509 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1438721047_1
2015-03-13 10:31:18,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:18,525 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from RUNNING to FINISHING
2015-03-13 10:31:18,525 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0002
2015-03-13 10:31:18,525 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from RUNNING to REMOVING
2015-03-13 10:31:18,525 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0002
2015-03-13 10:31:18,526 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from REMOVING to FINISHING
2015-03-13 10:31:19,207 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:19,369 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:19,370 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0002_01_000003
2015-03-13 10:31:19,370 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:19,370 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0002_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:31:19,370 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000003
2015-03-13 10:31:19,371 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:19,371 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:19,371 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0002_01_000003, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:19,371 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:19,372 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:19,372 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0002_000001 released container container_1426267835672_0002_01_000003 on node: host: 10.1.1.144:52469 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:19,524 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024
2015-03-13 10:31:19,525 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026
2015-03-13 10:31:19,525 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022
2015-03-13 10:31:19,526 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025
2015-03-13 10:31:19,535 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024
2015-03-13 10:31:19,535 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023
2015-03-13 10:31:19,536 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025
2015-03-13 10:31:19,537 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021
2015-03-13 10:31:19,537 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741840_1016 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:31:19,538 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741841_1017 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:31:19,538 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022
2015-03-13 10:31:19,538 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444 
2015-03-13 10:31:19,538 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 
2015-03-13 10:31:19,538 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741845_1021 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444 
2015-03-13 10:31:19,538 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 
2015-03-13 10:31:19,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0002	dst=null	perm=null
2015-03-13 10:31:19,574 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741836_1012 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52447 
2015-03-13 10:31:19,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/8559477721_map_741875FF46A2437E8909C83F6E499335	dst=null	perm=null
2015-03-13 10:31:19,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,577 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary
2015-03-13 10:31:19,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:19,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:19,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,580 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary
2015-03-13 10:31:19,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:19,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:19,582 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary
2015-03-13 10:31:19,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/_temporary	dst=null	perm=null
2015-03-13 10:31:19,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,583 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary
2015-03-13 10:31:19,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:19,594 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:19,595 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:19,596 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:19,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:19,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:19,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:19,601 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:19,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:19,612 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52640, bytes: 89, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 175000
2015-03-13 10:31:19,621 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:19,622 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:19,623 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:19,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,628 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 3
2015-03-13 10:31:19,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:31:19,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 215000
2015-03-13 10:31:19,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:31:19,633 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52640, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 161000
2015-03-13 10:31:19,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00002-00000	dst=null	perm=null
2015-03-13 10:31:19,636 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 31, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 206000
2015-03-13 10:31:19,636 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/eacheverychain/trap
2015-03-13 10:31:19,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap	dst=null	perm=null
2015-03-13 10:31:19,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:31:19,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:31:19,643 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741833_1009, duration: 176000
2015-03-13 10:31:19,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:31:19,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:31:19,646 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52640, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741835_1011, duration: 182000
2015-03-13 10:31:19,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00002-00000	dst=null	perm=null
2015-03-13 10:31:19,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/trap/part-r-00002-00000	dst=null	perm=null
2015-03-13 10:31:19,650 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52642, bytes: 31, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022, duration: 218000
2015-03-13 10:31:19,650 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/eacheverychain/tap
2015-03-13 10:31:19,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:19,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:19,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:19,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap	dst=null	perm=null
2015-03-13 10:31:19,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:19,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/eacheverychain/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:19,657 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 89, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023, duration: 204000
2015-03-13 10:31:19,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:19,677 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:19,681 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:31:19,681 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:31:19,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:19,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:19,700 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:31:19,700 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:31:19,700 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap"]
2015-03-13 10:31:19,700 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:31:19,701 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:31:19,701 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:31:19,701 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...atform/everyaggregate/tap
2015-03-13 10:31:19,711 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:19,720 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:19,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:19,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:19,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:19,726 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 3
2015-03-13 10:31:19,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003	dst=null	perm=null
2015-03-13 10:31:19,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:31:19,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:31:19,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:19,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,734 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:19,735 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52644 dest: /127.0.0.1:52444
2015-03-13 10:31:19,736 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52645 dest: /127.0.0.1:52451
2015-03-13 10:31:19,737 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52646 dest: /127.0.0.1:52447
2015-03-13 10:31:19,742 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52646, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 3107000
2015-03-13 10:31:19,743 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:19,743 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:19,743 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52645, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 4086000
2015-03-13 10:31:19,744 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,744 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:19,744 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52644, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 4482000
2015-03-13 10:31:19,744 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,746 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:19,747 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:19,748 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar
2015-03-13 10:31:19,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:19,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:19,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:19,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:19,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:31:19,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:31:19,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:31:19,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:31:19,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:31:19,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:19,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:19,758 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:19,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:19,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,765 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split
2015-03-13 10:31:19,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:19,767 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:19,769 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028 src: /127.0.0.1:52647 dest: /127.0.0.1:52454
2015-03-13 10:31:19,770 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028 src: /127.0.0.1:52648 dest: /127.0.0.1:52444
2015-03-13 10:31:19,771 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023
2015-03-13 10:31:19,771 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028 src: /127.0.0.1:52649 dest: /127.0.0.1:52447
2015-03-13 10:31:19,771 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021
2015-03-13 10:31:19,773 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026
2015-03-13 10:31:19,773 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028 src: /127.0.0.1:52650 dest: /127.0.0.1:52451
2015-03-13 10:31:19,776 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52650, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 1899000
2015-03-13 10:31:19,776 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:19,777 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:19,777 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52649, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 2563000
2015-03-13 10:31:19,777 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,778 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:19,778 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52648, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 3570000
2015-03-13 10:31:19,778 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,779 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:19,779 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52647, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 4175000
2015-03-13 10:31:19,779 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,779 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:19,783 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:19,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,788 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:19,790 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029 src: /127.0.0.1:52651 dest: /127.0.0.1:52454
2015-03-13 10:31:19,791 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029 src: /127.0.0.1:52652 dest: /127.0.0.1:52447
2015-03-13 10:31:19,792 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029 src: /127.0.0.1:52653 dest: /127.0.0.1:52444
2015-03-13 10:31:19,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52653, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 1512000
2015-03-13 10:31:19,795 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:19,795 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,796 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52652, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 2187000
2015-03-13 10:31:19,796 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,796 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,797 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52651, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 3120000
2015-03-13 10:31:19,797 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,798 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,799 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:19,799 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:31:19,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:19,804 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:19,804 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:19,805 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:19,817 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:19,819 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030 src: /127.0.0.1:52654 dest: /127.0.0.1:52454
2015-03-13 10:31:19,820 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030 src: /127.0.0.1:52655 dest: /127.0.0.1:52447
2015-03-13 10:31:19,821 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030 src: /127.0.0.1:52656 dest: /127.0.0.1:52444
2015-03-13 10:31:19,825 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52656, dest: /127.0.0.1:52444, bytes: 98170, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 1898000
2015-03-13 10:31:19,825 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:19,826 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,826 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52655, dest: /127.0.0.1:52447, bytes: 98170, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 2729000
2015-03-13 10:31:19,826 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,827 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,827 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52654, dest: /127.0.0.1:52454, bytes: 98170, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 3553000
2015-03-13 10:31:19,827 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:19,828 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:19,829 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:19,830 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0003
2015-03-13 10:31:19,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003	dst=null	perm=null
2015-03-13 10:31:19,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:19,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:19,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:19,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:19,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:19,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:19,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:19,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:19,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:19,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:19,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:19,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:19,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:19,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:19,846 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 3 submitted by user soberoi
2015-03-13 10:31:19,846 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0003
2015-03-13 10:31:19,846 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0003
2015-03-13 10:31:19,846 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0003
2015-03-13 10:31:19,846 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from NEW to NEW_SAVING
2015-03-13 10:31:19,847 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:31:19,847 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0003_000001
2015-03-13 10:31:19,847 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from NEW to SUBMITTED
2015-03-13 10:31:19,848 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0003 from user: soberoi activated in queue: default
2015-03-13 10:31:19,848 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0003 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:31:19,848 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0003 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:31:19,848 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0003_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:31:19,848 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0003 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:19,849 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:31:19,849 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from SUBMITTED to ACCEPTED
2015-03-13 10:31:19,851 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0003/
2015-03-13 10:31:19,851 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0003
2015-03-13 10:31:19,851 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0003/
2015-03-13 10:31:19,912 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024
2015-03-13 10:31:19,912 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741846_1022
2015-03-13 10:31:19,913 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028
2015-03-13 10:31:19,913 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741847_1023
2015-03-13 10:31:19,914 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741845_1021
2015-03-13 10:31:19,914 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741849_1025
2015-03-13 10:31:19,915 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741850_1026
2015-03-13 10:31:19,915 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029
2015-03-13 10:31:19,916 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030
2015-03-13 10:31:19,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027
2015-03-13 10:31:19,978 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028
2015-03-13 10:31:20,211 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:20,213 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:20,213 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000001
2015-03-13 10:31:20,213 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:31:20,214 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0003_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:20,214 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:31:20,215 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:20,215 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:20,215 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0003 AttemptId: appattempt_1426267835672_0003_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:31:20,215 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:31:20,215 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0003_000001
2015-03-13 10:31:20,216 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:31:20,216 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0003_000001
2015-03-13 10:31:20,217 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0003_000001
2015-03-13 10:31:20,217 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0003_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:31:20,220 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:20,222 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000001 by user soberoi
2015-03-13 10:31:20,222 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0003
2015-03-13 10:31:20,222 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000001
2015-03-13 10:31:20,222 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from NEW to INITING
2015-03-13 10:31:20,223 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000001 to application application_1426267835672_0003
2015-03-13 10:31:20,224 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from INITING to RUNNING
2015-03-13 10:31:20,224 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0003_000001
2015-03-13 10:31:20,224 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:31:20,224 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:31:20,224 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:20,225 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:20,225 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:31:20,225 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:31:20,225 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:20,225 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000001
2015-03-13 10:31:20,234 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0003_01_000001.tokens. Credentials list: 
2015-03-13 10:31:20,249 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:20,326 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0003_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001.tokens
2015-03-13 10:31:20,327 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:20,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:20,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:20,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:20,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52642, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711022976_1746, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 644000
2015-03-13 10:31:20,416 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:20,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:20,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:20,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:20,441 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52660, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711022976_1746, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 131000
2015-03-13 10:31:20,453 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:20,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:20,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:20,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:20,478 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52641, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711022976_1746, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 199000
2015-03-13 10:31:20,490 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:20,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:20,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:20,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:20,515 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52642, bytes: 98938, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711022976_1746, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 332000
2015-03-13 10:31:20,527 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:20,527 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:20,553 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:20,553 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:20,621 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001/default_container_executor.sh]
2015-03-13 10:31:21,213 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:21,213 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:21,214 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:21,881 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52447 to replicate blk_1073741851_1027 to datanode(s) 127.0.0.1:52454
2015-03-13 10:31:21,882 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021]
2015-03-13 10:31:21,882 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741844_1020, blk_1073741845_1021, blk_1073741836_1012]
2015-03-13 10:31:22,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:22,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:31:22,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:31:22,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:31:22,214 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:22,214 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:22,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003	dst=null	perm=null
2015-03-13 10:31:22,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:31:22,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:31:22,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:22,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:22,559 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-898105819-10.1.1.144-52447-1426267834396, infoPort=52448, ipcPort=52450, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 to 127.0.0.1:52454 
2015-03-13 10:31:22,561 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52662 dest: /127.0.0.1:52454
2015-03-13 10:31:22,561 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:31:22,562 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027 src: /127.0.0.1:52662 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:31:22,563 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741851_1027 size 254067
2015-03-13 10:31:22,597 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52663, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029, duration: 226000
2015-03-13 10:31:22,763 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840 for deletion
2015-03-13 10:31:22,763 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841 for deletion
2015-03-13 10:31:22,763 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843 for deletion
2015-03-13 10:31:22,763 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844 for deletion
2015-03-13 10:31:22,763 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845 for deletion
2015-03-13 10:31:22,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840
2015-03-13 10:31:22,764 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843
2015-03-13 10:31:22,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845
2015-03-13 10:31:22,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841
2015-03-13 10:31:22,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844
2015-03-13 10:31:22,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840 for deletion
2015-03-13 10:31:22,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841 for deletion
2015-03-13 10:31:22,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842 for deletion
2015-03-13 10:31:22,917 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844 for deletion
2015-03-13 10:31:22,917 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845 for deletion
2015-03-13 10:31:22,917 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836 for deletion
2015-03-13 10:31:22,917 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840
2015-03-13 10:31:22,918 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841
2015-03-13 10:31:22,918 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845
2015-03-13 10:31:22,918 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836
2015-03-13 10:31:22,918 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842
2015-03-13 10:31:22,919 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844
2015-03-13 10:31:23,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:23,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:23,338 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:23,340 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0003_000001
2015-03-13 10:31:23,341 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0003	APPATTEMPTID=appattempt_1426267835672_0003_000001
2015-03-13 10:31:23,341 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:31:23,341 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from ACCEPTED to RUNNING
2015-03-13 10:31:23,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:23,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:23,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:23,560 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:23,598 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031 src: /127.0.0.1:52669 dest: /127.0.0.1:52451
2015-03-13 10:31:23,600 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031 src: /127.0.0.1:52670 dest: /127.0.0.1:52444
2015-03-13 10:31:23,601 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031 src: /127.0.0.1:52671 dest: /127.0.0.1:52447
2015-03-13 10:31:23,613 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52671, dest: /127.0.0.1:52447, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, duration: 9954000
2015-03-13 10:31:23,613 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:23,614 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:23,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52670, dest: /127.0.0.1:52444, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, duration: 10860000
2015-03-13 10:31:23,614 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:23,615 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:23,615 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52669, dest: /127.0.0.1:52451, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, duration: 11961000
2015-03-13 10:31:23,615 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:23,615 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:23,624 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:24,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:24,226 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:24,370 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:24,370 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:24,370 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:24,370 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0003_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,371 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:31:24,371 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,371 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:24,371 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:24,371 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:31:24,372 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0003_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,372 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:31:24,372 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,373 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:24,373 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:24,373 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:31:24,373 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0003_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,373 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:31:24,373 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,374 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:24,374 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:24,374 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:31:24,374 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0003_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,374 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:31:24,374 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:24,536 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027
2015-03-13 10:31:24,536 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029
2015-03-13 10:31:24,537 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028
2015-03-13 10:31:24,538 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030
2015-03-13 10:31:24,546 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028
2015-03-13 10:31:24,547 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030
2015-03-13 10:31:24,548 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031
2015-03-13 10:31:24,580 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0002_01_000001 succeeded 
2015-03-13 10:31:24,581 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:31:24,581 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0002_01_000001
2015-03-13 10:31:24,589 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001
2015-03-13 10:31:24,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001
2015-03-13 10:31:24,590 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000001
2015-03-13 10:31:24,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001
2015-03-13 10:31:24,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0002/container_1426267835672_0002_01_000001
2015-03-13 10:31:24,591 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0002_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:31:24,592 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0002_01_000001 from application application_1426267835672_0002
2015-03-13 10:31:24,592 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:24,592 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0002
2015-03-13 10:31:24,741 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031
2015-03-13 10:31:24,752 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027
2015-03-13 10:31:24,753 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741853_1029
2015-03-13 10:31:24,885 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741836_1012]
2015-03-13 10:31:24,885 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741840_1016, blk_1073741841_1017, blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741836_1012]
2015-03-13 10:31:24,983 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031
2015-03-13 10:31:25,120 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027
2015-03-13 10:31:25,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:31:25,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0002_01_000001
2015-03-13 10:31:25,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:25,229 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0002_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:25,229 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0002_000001
2015-03-13 10:31:25,229 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0002_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:31:25,230 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0002_000001 State change from FINISHING to FINISHED
2015-03-13 10:31:25,230 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0002	CONTAINERID=container_1426267835672_0002_01_000001
2015-03-13 10:31:25,230 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0002 State change from FINISHING to FINISHED
2015-03-13 10:31:25,230 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:31:25,230 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0002
2015-03-13 10:31:25,230 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:31:25,230 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0002,name=[61C1702FCC0A429FBD628FD813F0535B/79C6C455F92F4DC7B488B1927023B72E] trap test/(2/2) ...atform/eacheverychain/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0002/jobhistory/job/job_1426267835672_0002,appMasterHost=Edinburgh.local,startTime=1426267864937,finishTime=1426267878526,finalStatus=SUCCEEDED
2015-03-13 10:31:25,231 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0002_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:25,231 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0002_000001
2015-03-13 10:31:25,231 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:25,231 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:31:25,231 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0002_000001 released container container_1426267835672_0002_01_000001 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:25,231 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0002_000001 is done. finalState=FINISHED
2015-03-13 10:31:25,232 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0002 requests cleared
2015-03-13 10:31:25,232 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0002 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:31:25,232 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0002 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:31:25,234 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0002_000001 (auth:SIMPLE)
2015-03-13 10:31:25,236 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0002_01_000001
2015-03-13 10:31:25,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:25,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:25,381 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:25,381 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:25,391 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:25,391 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0002
2015-03-13 10:31:25,391 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,392 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,392 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,392 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:25,392 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0002, with delay of 10800 seconds
2015-03-13 10:31:25,392 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:25,408 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:25,408 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,409 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,409 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,408 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0002
2015-03-13 10:31:25,409 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:25,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:25,410 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:25,410 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0002, with delay of 10800 seconds
2015-03-13 10:31:25,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:25,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:25,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:25,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:25,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:25,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:25,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:25,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:25,505 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:25,508 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000003 by user soberoi
2015-03-13 10:31:25,508 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000005 by user soberoi
2015-03-13 10:31:25,508 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000004 by user soberoi
2015-03-13 10:31:25,509 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:25,508 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0003
2015-03-13 10:31:25,509 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000005 to application application_1426267835672_0003
2015-03-13 10:31:25,508 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000002 by user soberoi
2015-03-13 10:31:25,509 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000004 to application application_1426267835672_0003
2015-03-13 10:31:25,510 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:25,510 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from NEW to INITING
2015-03-13 10:31:25,510 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000003 to application application_1426267835672_0003
2015-03-13 10:31:25,509 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:25,509 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:25,510 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000002 to application application_1426267835672_0003
2015-03-13 10:31:25,511 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from INITING to RUNNING
2015-03-13 10:31:25,511 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:31:25,512 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:31:25,512 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:31:25,512 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:31:25,512 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,512 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,513 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:25,513 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:25,513 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:25,513 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:25,513 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,513 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,513 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:25,514 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:25,514 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,514 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,514 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:25,514 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:25,515 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,515 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:25,515 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:25,515 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:25,515 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000003
2015-03-13 10:31:25,516 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000004
2015-03-13 10:31:25,516 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000005
2015-03-13 10:31:25,517 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0003_01_000002
2015-03-13 10:31:25,534 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000003.tokens. Credentials list: 
2015-03-13 10:31:25,535 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000002.tokens. Credentials list: 
2015-03-13 10:31:25,534 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000004.tokens. Credentials list: 
2015-03-13 10:31:25,535 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000005.tokens. Credentials list: 
2015-03-13 10:31:25,550 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840 for deletion
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840 for deletion
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841 for deletion
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841 for deletion
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842 for deletion
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842 for deletion
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843 for deletion
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741841_1017 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741841
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741840_1016 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741840
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843 for deletion
2015-03-13 10:31:25,560 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842
2015-03-13 10:31:25,560 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843
2015-03-13 10:31:25,560 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836 for deletion
2015-03-13 10:31:25,560 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741843
2015-03-13 10:31:25,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741842
2015-03-13 10:31:25,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836
2015-03-13 10:31:25,560 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844 for deletion
2015-03-13 10:31:25,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845 for deletion
2015-03-13 10:31:25,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836 for deletion
2015-03-13 10:31:25,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741844
2015-03-13 10:31:25,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741845
2015-03-13 10:31:25,562 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741836_1012 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741836
2015-03-13 10:31:25,621 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002.tokens
2015-03-13 10:31:25,621 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:25,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:25,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:25,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar	dst=null	perm=null
2015-03-13 10:31:25,691 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52676, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1461837696_1865, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741851_1027, duration: 640000
2015-03-13 10:31:25,710 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:25,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:25,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:25,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml	dst=null	perm=null
2015-03-13 10:31:25,738 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52676, bytes: 98938, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1461837696_1865, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741854_1030, duration: 366000
2015-03-13 10:31:25,751 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:25,751 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:25,751 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:25,751 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:25,751 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:25,816 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:25,816 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:25,817 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:25,817 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:25,817 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:25,817 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:25,818 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:25,818 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:25,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002/default_container_executor.sh]
2015-03-13 10:31:25,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005/default_container_executor.sh]
2015-03-13 10:31:25,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004/default_container_executor.sh]
2015-03-13 10:31:25,928 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003/default_container_executor.sh]
2015-03-13 10:31:26,230 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,231 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:26,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:26,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:26,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:26,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0002
2015-03-13 10:31:26,232 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0002
2015-03-13 10:31:26,233 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:26,233 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0002, with delay of 10800 seconds
2015-03-13 10:31:26,377 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,377 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:26,378 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:26,379 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:26,379 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:26,379 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:26,393 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:31:26,782 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:26,896 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005.tokens
2015-03-13 10:31:26,897 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:27,011 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:27,128 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004.tokens
2015-03-13 10:31:27,128 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:27,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:27,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:27,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0003_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003.tokens
2015-03-13 10:31:27,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:27,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:27,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:27,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:27,382 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,386 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:28,386 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,238 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,388 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:29,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,239 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:30,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,240 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,395 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,396 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,396 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:31,396 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:32,400 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,400 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,400 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:32,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:32,540 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52686, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000002_0_971355757_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 245000
2015-03-13 10:31:32,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:32,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job.split	dst=null	perm=null
2015-03-13 10:31:32,652 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52689, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000001_0_447082370_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 215000
2015-03-13 10:31:32,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:32,691 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52691, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000002_0_971355757_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 196000
2015-03-13 10:31:32,693 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52690, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000003_0_-30378997_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 185000
2015-03-13 10:31:32,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52692, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000000_0_-1010613618_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741852_1028, duration: 205000
2015-03-13 10:31:32,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:32,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:32,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:32,808 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52690, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000003_0_-30378997_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 251000
2015-03-13 10:31:32,811 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52693, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000000_0_-1010613618_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 168000
2015-03-13 10:31:33,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_m_000002_0	dst=null	perm=null
2015-03-13 10:31:33,101 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000004
2015-03-13 10:31:33,101 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:33,101 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:31:33,102 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000004
2015-03-13 10:31:33,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:33,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,115 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000004 is : 143
2015-03-13 10:31:33,117 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:33,118 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032 src: /127.0.0.1:52694 dest: /127.0.0.1:52451
2015-03-13 10:31:33,121 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032 src: /127.0.0.1:52695 dest: /127.0.0.1:52447
2015-03-13 10:31:33,122 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032 src: /127.0.0.1:52696 dest: /127.0.0.1:52444
2015-03-13 10:31:33,129 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist for DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:33,132 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:33,132 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004
2015-03-13 10:31:33,132 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004
2015-03-13 10:31:33,133 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004
2015-03-13 10:31:33,133 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:33,133 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:33,133 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000004 from application application_1426267835672_0003
2015-03-13 10:31:33,133 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:33,133 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:33,133 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000004
2015-03-13 10:31:33,151 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52689, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0003_m_000001_0_447082370_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 244000
2015-03-13 10:31:33,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_m_000001_0	dst=null	perm=null
2015-03-13 10:31:33,198 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000003
2015-03-13 10:31:33,198 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:33,198 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:31:33,199 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000003
2015-03-13 10:31:33,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:33,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:33,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000004
2015-03-13 10:31:33,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,201 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:33,201 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:31:33,201 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000004
2015-03-13 10:31:33,201 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:31:33,202 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:31:33,202 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,202 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,202 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:31:33,202 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000004 on node: host: 10.1.1.144:52481 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:31:33,211 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000003 is : 143
2015-03-13 10:31:33,225 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:33,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003
2015-03-13 10:31:33,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003
2015-03-13 10:31:33,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003
2015-03-13 10:31:33,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000003
2015-03-13 10:31:33,227 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:33,227 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:33,228 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000003 from application application_1426267835672_0003
2015-03-13 10:31:33,228 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:33,228 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:33,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_m_000000_0	dst=null	perm=null
2015-03-13 10:31:33,257 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000002
2015-03-13 10:31:33,258 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:33,258 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:31:33,258 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000002
2015-03-13 10:31:33,258 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:33,259 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:33,259 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000003
2015-03-13 10:31:33,259 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:33,260 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:33,260 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:31:33,260 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000003
2015-03-13 10:31:33,260 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:31:33,260 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:31:33,260 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,260 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,261 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:31:33,261 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000003 on node: host: 10.1.1.144:52481 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:33,271 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000002 is : 143
2015-03-13 10:31:33,284 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:33,284 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002
2015-03-13 10:31:33,284 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002
2015-03-13 10:31:33,285 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002
2015-03-13 10:31:33,285 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000002
2015-03-13 10:31:33,286 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:33,286 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:33,286 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000002 from application application_1426267835672_0003
2015-03-13 10:31:33,286 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:33,286 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:33,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_m_000003_0	dst=null	perm=null
2015-03-13 10:31:33,299 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000005
2015-03-13 10:31:33,299 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:33,299 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:31:33,300 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000005
2015-03-13 10:31:33,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:33,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000002
2015-03-13 10:31:33,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:33,301 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:33,301 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:31:33,301 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000002
2015-03-13 10:31:33,301 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:31:33,301 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:31:33,301 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,302 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:33,302 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:33,302 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000002 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:31:33,309 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000005 is : 143
2015-03-13 10:31:33,318 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:33,319 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005
2015-03-13 10:31:33,319 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005
2015-03-13 10:31:33,320 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005
2015-03-13 10:31:33,320 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000005
2015-03-13 10:31:33,321 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:33,321 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:33,322 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000005 from application application_1426267835672_0003
2015-03-13 10:31:33,322 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:33,322 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:34,242 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:34,303 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:34,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000005
2015-03-13 10:31:34,304 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:34,305 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:31:34,305 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000005
2015-03-13 10:31:34,305 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:34,305 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:34,306 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:34,306 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:34,306 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:34,306 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000005 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:35,243 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:35,245 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:35,245 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:35,245 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:31:35,245 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0003 container=Container: [ContainerId: container_1426267835672_0003_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0003_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:35,245 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:35,246 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:35,438 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:35,448 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:35,451 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0003_01_000006 by user soberoi
2015-03-13 10:31:35,451 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:35,451 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0003_01_000006 to application application_1426267835672_0003
2015-03-13 10:31:35,452 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:31:35,452 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0003
2015-03-13 10:31:35,452 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0003
2015-03-13 10:31:35,452 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:35,452 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0003
2015-03-13 10:31:35,453 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:35,478 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:35,478 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:35,544 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006/default_container_executor.sh]
2015-03-13 10:31:36,245 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:36,246 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:36,246 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:36,444 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:31:37,250 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:37,251 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:37,834 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 281 Total time for transactions(ms): 21 Number of transactions batched in Syncs: 3 Number of syncs: 144 SyncTimes(ms): 40 20 
2015-03-13 10:31:37,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:37,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:37,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:37,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:37,897 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:37,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033 src: /127.0.0.1:52702 dest: /127.0.0.1:52454
2015-03-13 10:31:37,955 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033 src: /127.0.0.1:52703 dest: /127.0.0.1:52451
2015-03-13 10:31:37,956 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033 src: /127.0.0.1:52704 dest: /127.0.0.1:52444
2015-03-13 10:31:37,966 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52704, dest: /127.0.0.1:52444, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 8604000
2015-03-13 10:31:37,966 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:37,967 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:37,967 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52703, dest: /127.0.0.1:52451, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 9134000
2015-03-13 10:31:37,967 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:37,967 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:37,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52702, dest: /127.0.0.1:52454, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 10135000
2015-03-13 10:31:37,968 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:37,968 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:37,971 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1
2015-03-13 10:31:37,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0	dst=null	perm=null
2015-03-13 10:31:37,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0	dst=null	perm=null
2015-03-13 10:31:37,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0	dst=null	perm=null
2015-03-13 10:31:37,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0	dst=null	perm=null
2015-03-13 10:31:37,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0	dst=null	perm=null
2015-03-13 10:31:37,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:37,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:31:37,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0/part-r-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/part-r-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:37,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary/_attempt_1426267835672_0003_r_000000_0	dst=null	perm=null
2015-03-13 10:31:37,998 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0003_r_000000_0_-1820297791_1
2015-03-13 10:31:38,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0	dst=null	perm=null
2015-03-13 10:31:38,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0	dst=null	perm=null
2015-03-13 10:31:38,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/task_1426267835672_0003_r_000000	dst=null	perm=null
2015-03-13 10:31:38,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/_temporary/attempt_1426267835672_0003_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/task_1426267835672_0003_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:38,018 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000006
2015-03-13 10:31:38,018 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:38,018 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:31:38,018 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000006
2015-03-13 10:31:38,019 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:38,019 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:38,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,026 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,029 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0003_01_000006 is : 143
2015-03-13 10:31:38,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1	dst=null	perm=null
2015-03-13 10:31:38,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:38,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:38,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/task_1426267835672_0003_r_000000	dst=null	perm=null
2015-03-13 10:31:38,039 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:38,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:38,040 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006
2015-03-13 10:31:38,039 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:38,040 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:38,040 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000006 from application application_1426267835672_0003
2015-03-13 10:31:38,040 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:38,040 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:38,039 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006
2015-03-13 10:31:38,039 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006
2015-03-13 10:31:38,040 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000006
2015-03-13 10:31:38,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary/1/task_1426267835672_0003_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary	dst=null	perm=null
2015-03-13 10:31:38,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,052 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,056 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,069 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52696, dest: /127.0.0.1:52444, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, duration: 4944789000
2015-03-13 10:31:38,069 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:38,070 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,070 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52695, dest: /127.0.0.1:52447, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, duration: 4944489000
2015-03-13 10:31:38,070 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,071 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,071 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52694, dest: /127.0.0.1:52451, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, duration: 4946978000
2015-03-13 10:31:38,071 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,072 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,073 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,077 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:38,079 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034 src: /127.0.0.1:52705 dest: /127.0.0.1:52444
2015-03-13 10:31:38,081 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034 src: /127.0.0.1:52706 dest: /127.0.0.1:52454
2015-03-13 10:31:38,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034 src: /127.0.0.1:52707 dest: /127.0.0.1:52447
2015-03-13 10:31:38,085 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52707, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, duration: 1354000
2015-03-13 10:31:38,085 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:38,085 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,085 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52706, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, duration: 1781000
2015-03-13 10:31:38,086 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,086 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,086 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52705, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, duration: 2852000
2015-03-13 10:31:38,087 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,088 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,089 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist	dst=null	perm=null
2015-03-13 10:31:38,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:31:38,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist	dst=null	perm=null
2015-03-13 10:31:38,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:31:38,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1.jhist	dst=null	perm=null
2015-03-13 10:31:38,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,109 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52708, bytes: 60212, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032, duration: 265000
2015-03-13 10:31:38,111 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:38,113 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035 src: /127.0.0.1:52709 dest: /127.0.0.1:52447
2015-03-13 10:31:38,115 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035 src: /127.0.0.1:52710 dest: /127.0.0.1:52451
2015-03-13 10:31:38,116 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035 src: /127.0.0.1:52711 dest: /127.0.0.1:52444
2015-03-13 10:31:38,119 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52711, dest: /127.0.0.1:52444, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, duration: 1701000
2015-03-13 10:31:38,120 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:38,120 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,120 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52710, dest: /127.0.0.1:52451, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, duration: 2432000
2015-03-13 10:31:38,121 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,121 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,121 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52709, dest: /127.0.0.1:52447, bytes: 59744, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, duration: 3726000
2015-03-13 10:31:38,122 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,122 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:38,123 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:38,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:31:38,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:38,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:31:38,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003/job_1426267835672_0003_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:38,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:38,138 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52712, bytes: 91469, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741855_1031, duration: 371000
2015-03-13 10:31:38,140 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:38,142 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036 src: /127.0.0.1:52713 dest: /127.0.0.1:52444
2015-03-13 10:31:38,143 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036 src: /127.0.0.1:52714 dest: /127.0.0.1:52454
2015-03-13 10:31:38,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036 src: /127.0.0.1:52715 dest: /127.0.0.1:52447
2015-03-13 10:31:38,147 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52715, dest: /127.0.0.1:52447, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, duration: 1975000
2015-03-13 10:31:38,147 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:38,148 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,148 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52714, dest: /127.0.0.1:52454, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, duration: 2484000
2015-03-13 10:31:38,148 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,148 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,149 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52713, dest: /127.0.0.1:52444, bytes: 90757, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-871089668_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, duration: 3394000
2015-03-13 10:31:38,149 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:38,150 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:38,151 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-871089668_1
2015-03-13 10:31:38,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:38,167 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from RUNNING to FINISHING
2015-03-13 10:31:38,167 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0003
2015-03-13 10:31:38,167 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from RUNNING to REMOVING
2015-03-13 10:31:38,167 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0003
2015-03-13 10:31:38,167 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from REMOVING to FINISHING
2015-03-13 10:31:39,020 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:39,020 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:39,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000006
2015-03-13 10:31:39,021 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:39,022 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:31:39,022 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000006
2015-03-13 10:31:39,022 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:31:39,022 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:39,023 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:39,023 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:39,023 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:39,023 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000006 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:39,179 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741851_1027 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:31:39,179 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741852_1028 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52451 
2015-03-13 10:31:39,179 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741853_1029 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444 
2015-03-13 10:31:39,179 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741854_1030 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444 
2015-03-13 10:31:39,180 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741856_1032 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52444 
2015-03-13 10:31:39,180 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741855_1031 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:31:39,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0003	dst=null	perm=null
2015-03-13 10:31:39,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:39,219 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary
2015-03-13 10:31:39,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/_temporary	dst=null	perm=null
2015-03-13 10:31:39,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:39,221 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary
2015-03-13 10:31:39,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:39,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:39,230 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:39,231 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:39,232 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:39,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:39,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:39,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:39,236 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:39,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:39,245 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:39,246 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:39,247 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:39,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:39,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:39,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:39,252 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:39,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:31:39,255 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52717, bytes: 144, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 187000
2015-03-13 10:31:39,255 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everyaggregate/trap
2015-03-13 10:31:39,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:39,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:39,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:39,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap	dst=null	perm=null
2015-03-13 10:31:39,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:31:39,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:31:39,262 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52718, bytes: 144, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033, duration: 203000
2015-03-13 10:31:39,262 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everyaggregate/tap
2015-03-13 10:31:39,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:39,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:39,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:39,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap	dst=null	perm=null
2015-03-13 10:31:39,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:39,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everyaggregate/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:39,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:39,286 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:39,289 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:31:39,289 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:31:39,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:39,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:39,305 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:31:39,306 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:31:39,306 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap"]
2015-03-13 10:31:39,306 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:31:39,306 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:31:39,306 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:31:39,307 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...-mr1/trapplatform/all/tap
2015-03-13 10:31:39,319 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:39,333 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:39,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:39,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:39,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:39,340 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 4
2015-03-13 10:31:39,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004	dst=null	perm=null
2015-03-13 10:31:39,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:31:39,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:31:39,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:39,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,349 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:39,350 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52720 dest: /127.0.0.1:52447
2015-03-13 10:31:39,351 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52721 dest: /127.0.0.1:52454
2015-03-13 10:31:39,353 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52722 dest: /127.0.0.1:52451
2015-03-13 10:31:39,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52722, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 3011000
2015-03-13 10:31:39,358 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:39,358 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:39,358 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52721, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 3351000
2015-03-13 10:31:39,359 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,359 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:39,360 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52720, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 4865000
2015-03-13 10:31:39,360 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,361 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:39,363 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:39,364 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar
2015-03-13 10:31:39,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:39,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:39,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:39,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:39,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:31:39,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:31:39,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:31:39,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:31:39,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:31:39,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:39,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:39,378 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:39,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:39,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,385 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split
2015-03-13 10:31:39,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:39,391 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:39,392 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038 src: /127.0.0.1:52723 dest: /127.0.0.1:52454
2015-03-13 10:31:39,394 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038 src: /127.0.0.1:52724 dest: /127.0.0.1:52444
2015-03-13 10:31:39,395 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038 src: /127.0.0.1:52725 dest: /127.0.0.1:52451
2015-03-13 10:31:39,397 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038 src: /127.0.0.1:52726 dest: /127.0.0.1:52447
2015-03-13 10:31:39,401 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52726, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 2175000
2015-03-13 10:31:39,401 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:39,402 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:39,402 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52725, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 2884000
2015-03-13 10:31:39,402 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,403 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52724, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 4281000
2015-03-13 10:31:39,403 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,404 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52723, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 5175000
2015-03-13 10:31:39,405 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:39,405 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,407 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:39,407 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:39,409 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:39,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,416 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:39,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039 src: /127.0.0.1:52727 dest: /127.0.0.1:52447
2015-03-13 10:31:39,419 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039 src: /127.0.0.1:52728 dest: /127.0.0.1:52454
2015-03-13 10:31:39,421 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039 src: /127.0.0.1:52729 dest: /127.0.0.1:52444
2015-03-13 10:31:39,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52729, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 1527000
2015-03-13 10:31:39,424 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:39,424 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52728, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 2118000
2015-03-13 10:31:39,425 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,426 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,426 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52727, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 3211000
2015-03-13 10:31:39,426 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,426 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,431 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:39,431 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:31:39,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:39,437 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:39,437 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:39,438 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:39,445 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:39,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040 src: /127.0.0.1:52730 dest: /127.0.0.1:52447
2015-03-13 10:31:39,448 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040 src: /127.0.0.1:52731 dest: /127.0.0.1:52454
2015-03-13 10:31:39,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040 src: /127.0.0.1:52732 dest: /127.0.0.1:52444
2015-03-13 10:31:39,454 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52732, dest: /127.0.0.1:52444, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 4163000
2015-03-13 10:31:39,454 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:39,455 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,455 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52731, dest: /127.0.0.1:52454, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 4721000
2015-03-13 10:31:39,455 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,455 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52730, dest: /127.0.0.1:52447, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 5630000
2015-03-13 10:31:39,456 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:39,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:39,458 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:39,459 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0004
2015-03-13 10:31:39,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004	dst=null	perm=null
2015-03-13 10:31:39,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:39,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:39,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:39,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:39,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:39,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:39,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:39,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:39,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:39,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:39,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:39,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:39,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:39,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:39,477 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 4 submitted by user soberoi
2015-03-13 10:31:39,477 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0004
2015-03-13 10:31:39,478 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0004
2015-03-13 10:31:39,478 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0004
2015-03-13 10:31:39,478 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from NEW to NEW_SAVING
2015-03-13 10:31:39,478 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:31:39,478 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0004_000001
2015-03-13 10:31:39,479 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from NEW to SUBMITTED
2015-03-13 10:31:39,480 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0004 from user: soberoi activated in queue: default
2015-03-13 10:31:39,480 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0004 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:31:39,480 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0004 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:31:39,480 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0004 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:39,480 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0004_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:31:39,480 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:31:39,481 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from SUBMITTED to ACCEPTED
2015-03-13 10:31:39,483 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0004/
2015-03-13 10:31:39,483 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0004
2015-03-13 10:31:39,483 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0004/
2015-03-13 10:31:39,752 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035
2015-03-13 10:31:39,753 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032
2015-03-13 10:31:39,754 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034
2015-03-13 10:31:39,754 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039
2015-03-13 10:31:39,755 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036
2015-03-13 10:31:39,756 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040
2015-03-13 10:31:39,756 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038
2015-03-13 10:31:39,770 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038
2015-03-13 10:31:39,771 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035
2015-03-13 10:31:39,772 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032
2015-03-13 10:31:39,773 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040
2015-03-13 10:31:39,773 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034
2015-03-13 10:31:39,774 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036
2015-03-13 10:31:39,775 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033
2015-03-13 10:31:39,775 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039
2015-03-13 10:31:39,901 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52454 to replicate blk_1073741861_1037 to datanode(s) 127.0.0.1:52444
2015-03-13 10:31:39,901 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741856_1032, blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031]
2015-03-13 10:31:39,901 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741856_1032, blk_1073741851_1027, blk_1073741852_1028, blk_1073741855_1031]
2015-03-13 10:31:39,958 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037
2015-03-13 10:31:39,997 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741859_1035
2015-03-13 10:31:39,997 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741856_1032
2015-03-13 10:31:40,023 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:40,025 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:40,025 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000001
2015-03-13 10:31:40,025 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:31:40,026 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0004_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:40,026 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:31:40,027 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:40,027 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:40,027 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0004 AttemptId: appattempt_1426267835672_0004_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:31:40,028 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:31:40,028 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0004_000001
2015-03-13 10:31:40,028 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:31:40,029 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0004_000001
2015-03-13 10:31:40,029 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0004_000001
2015-03-13 10:31:40,029 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0004_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:31:40,032 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0004_000001 (auth:SIMPLE)
2015-03-13 10:31:40,034 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000001 by user soberoi
2015-03-13 10:31:40,034 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0004
2015-03-13 10:31:40,035 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000001
2015-03-13 10:31:40,035 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from NEW to INITING
2015-03-13 10:31:40,035 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000001 to application application_1426267835672_0004
2015-03-13 10:31:40,035 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from INITING to RUNNING
2015-03-13 10:31:40,035 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0004_000001
2015-03-13 10:31:40,035 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:31:40,036 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:40,036 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:31:40,036 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:40,036 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:31:40,036 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:31:40,036 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:40,037 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000001
2015-03-13 10:31:40,046 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0004_01_000001.tokens. Credentials list: 
2015-03-13 10:31:40,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:40,132 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034
2015-03-13 10:31:40,133 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040
2015-03-13 10:31:40,134 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038
2015-03-13 10:31:40,134 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033
2015-03-13 10:31:40,135 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741860_1036
2015-03-13 10:31:40,135 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039
2015-03-13 10:31:40,138 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0004_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001.tokens
2015-03-13 10:31:40,138 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:40,201 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037
2015-03-13 10:31:40,202 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741857_1033
2015-03-13 10:31:40,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:40,202 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038
2015-03-13 10:31:40,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:40,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:40,213 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52736, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-221713480_2226, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 514000
2015-03-13 10:31:40,238 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:40,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:40,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:40,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:40,264 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52736, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-221713480_2226, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 191000
2015-03-13 10:31:40,278 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:40,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:40,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:40,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:40,306 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52737, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-221713480_2226, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 166000
2015-03-13 10:31:40,321 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:40,336 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037
2015-03-13 10:31:40,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:40,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:40,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:40,353 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52736, bytes: 98956, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-221713480_2226, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 353000
2015-03-13 10:31:40,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:40,366 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:40,392 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:40,393 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:40,462 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001/default_container_executor.sh]
2015-03-13 10:31:40,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856 for deletion
2015-03-13 10:31:40,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851 for deletion
2015-03-13 10:31:40,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852 for deletion
2015-03-13 10:31:40,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853 for deletion
2015-03-13 10:31:40,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854 for deletion
2015-03-13 10:31:40,578 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855 for deletion
2015-03-13 10:31:40,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856
2015-03-13 10:31:40,578 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851
2015-03-13 10:31:40,578 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852
2015-03-13 10:31:40,578 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853
2015-03-13 10:31:40,578 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854
2015-03-13 10:31:40,578 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855
2015-03-13 10:31:40,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856 for deletion
2015-03-13 10:31:40,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851 for deletion
2015-03-13 10:31:40,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852 for deletion
2015-03-13 10:31:40,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855 for deletion
2015-03-13 10:31:40,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851
2015-03-13 10:31:40,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856
2015-03-13 10:31:40,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855
2015-03-13 10:31:40,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852
2015-03-13 10:31:40,938 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 to 127.0.0.1:52444 
2015-03-13 10:31:40,940 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52738 dest: /127.0.0.1:52444
2015-03-13 10:31:40,941 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 (numBytes=254067) to /127.0.0.1:52444
2015-03-13 10:31:40,942 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037 src: /127.0.0.1:52738 dest: /127.0.0.1:52444 of size 254067
2015-03-13 10:31:40,943 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741861_1037 size 254067
2015-03-13 10:31:41,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:41,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:41,028 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:42,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:42,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:42,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:42,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:31:42,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:31:42,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:31:42,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004	dst=null	perm=null
2015-03-13 10:31:42,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:31:42,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:31:42,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:42,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:42,456 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52740, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741863_1039, duration: 225000
2015-03-13 10:31:42,902 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030]
2015-03-13 10:31:42,902 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741856_1032, blk_1073741851_1027, blk_1073741852_1028, blk_1073741853_1029, blk_1073741854_1030, blk_1073741855_1031]
2015-03-13 10:31:43,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:43,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:43,224 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0004_000001 (auth:SIMPLE)
2015-03-13 10:31:43,226 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0004_000001
2015-03-13 10:31:43,226 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0004	APPATTEMPTID=appattempt_1426267835672_0004_000001
2015-03-13 10:31:43,226 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:31:43,226 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from ACCEPTED to RUNNING
2015-03-13 10:31:43,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:43,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:43,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:43,435 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:43,490 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041 src: /127.0.0.1:52746 dest: /127.0.0.1:52444
2015-03-13 10:31:43,491 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041 src: /127.0.0.1:52747 dest: /127.0.0.1:52451
2015-03-13 10:31:43,493 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041 src: /127.0.0.1:52748 dest: /127.0.0.1:52454
2015-03-13 10:31:43,500 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52748, dest: /127.0.0.1:52454, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, duration: 5839000
2015-03-13 10:31:43,500 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:43,501 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:43,501 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52747, dest: /127.0.0.1:52451, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, duration: 6601000
2015-03-13 10:31:43,501 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:43,502 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:43,502 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52746, dest: /127.0.0.1:52444, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, duration: 7615000
2015-03-13 10:31:43,502 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:43,503 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:43,506 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:43,582 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856 for deletion
2015-03-13 10:31:43,582 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851 for deletion
2015-03-13 10:31:43,582 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852 for deletion
2015-03-13 10:31:43,583 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853 for deletion
2015-03-13 10:31:43,583 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854 for deletion
2015-03-13 10:31:43,583 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851
2015-03-13 10:31:43,583 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855 for deletion
2015-03-13 10:31:43,583 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741856
2015-03-13 10:31:43,583 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853
2015-03-13 10:31:43,583 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852
2015-03-13 10:31:43,583 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741855_1031 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741855
2015-03-13 10:31:43,584 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854
2015-03-13 10:31:43,937 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851 for deletion
2015-03-13 10:31:43,937 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852 for deletion
2015-03-13 10:31:43,937 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853 for deletion
2015-03-13 10:31:43,937 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854 for deletion
2015-03-13 10:31:43,937 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741852
2015-03-13 10:31:43,937 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741851
2015-03-13 10:31:43,938 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741854_1030 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741854
2015-03-13 10:31:43,938 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741853
2015-03-13 10:31:44,047 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:44,047 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:44,309 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0003_01_000001 succeeded 
2015-03-13 10:31:44,310 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:31:44,310 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0003_01_000001
2015-03-13 10:31:44,318 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001
2015-03-13 10:31:44,318 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001
2015-03-13 10:31:44,319 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000001
2015-03-13 10:31:44,319 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001
2015-03-13 10:31:44,318 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0003/container_1426267835672_0003_01_000001
2015-03-13 10:31:44,319 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0003_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:31:44,319 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0003_01_000001 from application application_1426267835672_0003
2015-03-13 10:31:44,319 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:44,320 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0003
2015-03-13 10:31:44,331 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:44,331 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:44,331 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:44,331 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,332 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:31:44,332 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,332 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:44,332 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:44,332 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:31:44,333 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,333 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:31:44,333 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,333 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:44,333 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:44,334 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:31:44,334 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,334 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:31:44,334 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,334 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:44,334 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:44,335 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:31:44,335 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,335 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:31:44,335 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:44,781 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041
2015-03-13 10:31:44,981 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037
2015-03-13 10:31:45,052 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:31:45,053 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0003_01_000001
2015-03-13 10:31:45,053 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:45,054 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0003_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:45,054 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0003_000001
2015-03-13 10:31:45,054 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0003_000001 State change from FINISHING to FINISHED
2015-03-13 10:31:45,054 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0003_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:31:45,055 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0003 State change from FINISHING to FINISHED
2015-03-13 10:31:45,055 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0003	CONTAINERID=container_1426267835672_0003_01_000001
2015-03-13 10:31:45,055 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0003
2015-03-13 10:31:45,055 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0003,name=[A5DA9BA04876490E83B797AC0CE57F3F/1D775ED593824D6FA1483A7D4ADBD8AA] trap test/(1/1) ...atform/everyaggregate/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0003/jobhistory/job/job_1426267835672_0003,appMasterHost=Edinburgh.local,startTime=1426267879845,finishTime=1426267898167,finalStatus=SUCCEEDED
2015-03-13 10:31:45,055 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:31:45,055 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0003_000001
2015-03-13 10:31:45,055 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:31:45,056 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0003_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:45,056 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:45,056 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:31:45,056 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0003_000001 released container container_1426267835672_0003_01_000001 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:45,056 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0003_000001 is done. finalState=FINISHED
2015-03-13 10:31:45,057 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0003 requests cleared
2015-03-13 10:31:45,057 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0003 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:31:45,057 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0003 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:31:45,059 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0003_000001 (auth:SIMPLE)
2015-03-13 10:31:45,060 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0003_01_000001
2015-03-13 10:31:45,208 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041
2015-03-13 10:31:45,259 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:45,259 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:45,260 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:45,261 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:45,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:45,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:45,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:45,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:45,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:45,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:45,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:45,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:45,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:45,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:45,333 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:45,334 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0003
2015-03-13 10:31:45,334 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:45,334 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0003, with delay of 10800 seconds
2015-03-13 10:31:45,335 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:45,335 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:45,336 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:45,336 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:45,340 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041
2015-03-13 10:31:45,387 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0004_000001 (auth:SIMPLE)
2015-03-13 10:31:45,390 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000003 by user soberoi
2015-03-13 10:31:45,391 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000004 by user soberoi
2015-03-13 10:31:45,390 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000002 by user soberoi
2015-03-13 10:31:45,391 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:45,391 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:45,390 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000005 by user soberoi
2015-03-13 10:31:45,391 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000004 to application application_1426267835672_0004
2015-03-13 10:31:45,392 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000002 to application application_1426267835672_0004
2015-03-13 10:31:45,392 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000005 to application application_1426267835672_0004
2015-03-13 10:31:45,391 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0004
2015-03-13 10:31:45,391 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:45,392 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from NEW to INITING
2015-03-13 10:31:45,392 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000003 to application application_1426267835672_0004
2015-03-13 10:31:45,392 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:45,392 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from INITING to RUNNING
2015-03-13 10:31:45,393 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:31:45,393 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:31:45,393 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:31:45,394 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:31:45,394 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,394 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,394 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:45,394 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:45,394 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:45,394 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:45,394 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,395 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,395 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:45,395 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:45,395 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,395 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,395 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:45,395 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:45,396 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,396 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:45,396 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:45,396 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:45,396 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000002
2015-03-13 10:31:45,397 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000005
2015-03-13 10:31:45,400 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000004
2015-03-13 10:31:45,402 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0004_01_000003
2015-03-13 10:31:45,420 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000002.tokens. Credentials list: 
2015-03-13 10:31:45,421 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000005.tokens. Credentials list: 
2015-03-13 10:31:45,421 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000003.tokens. Credentials list: 
2015-03-13 10:31:45,421 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0004_01_000004.tokens. Credentials list: 
2015-03-13 10:31:45,436 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:45,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002.tokens
2015-03-13 10:31:45,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:45,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:45,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:45,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar	dst=null	perm=null
2015-03-13 10:31:45,576 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52753, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_6864609_2341, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741861_1037, duration: 540000
2015-03-13 10:31:45,594 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:45,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:45,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:45,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml	dst=null	perm=null
2015-03-13 10:31:45,618 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52754, bytes: 98956, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_6864609_2341, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741864_1040, duration: 338000
2015-03-13 10:31:45,631 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:45,631 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:45,631 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:45,631 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:45,631 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:45,679 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:45,679 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:45,686 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:45,686 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:45,686 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:45,686 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:45,693 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:45,693 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:45,784 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005/default_container_executor.sh]
2015-03-13 10:31:45,789 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003/default_container_executor.sh]
2015-03-13 10:31:45,790 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004/default_container_executor.sh]
2015-03-13 10:31:45,795 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002/default_container_executor.sh]
2015-03-13 10:31:46,057 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,058 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:31:46,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:46,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:46,058 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0003
2015-03-13 10:31:46,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:46,058 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:31:46,058 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0003, with delay of 10800 seconds
2015-03-13 10:31:46,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0003
2015-03-13 10:31:46,275 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:31:46,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,337 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,337 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:46,337 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:46,337 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:46,338 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:46,338 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:46,663 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:46,789 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0004_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004.tokens
2015-03-13 10:31:46,789 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:46,899 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:47,014 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005.tokens
2015-03-13 10:31:47,014 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:47,059 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:47,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:47,235 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0004_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003.tokens
2015-03-13 10:31:47,235 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:31:47,338 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:47,338 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:47,338 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:47,339 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,064 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,339 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:48,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,066 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,343 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:49,345 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,066 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,346 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:50,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,069 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:51,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:52,074 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:52,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:52,277 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52765, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 181000
2015-03-13 10:31:52,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job.split	dst=null	perm=null
2015-03-13 10:31:52,357 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,358 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,358 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,358 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,369 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52767, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 190000
2015-03-13 10:31:52,374 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52768, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 241000
2015-03-13 10:31:52,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:52,413 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52765, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 201000
2015-03-13 10:31:52,452 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52769, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741862_1038, duration: 183000
2015-03-13 10:31:52,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:52,477 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52770, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 243000
2015-03-13 10:31:52,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:52,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:52,540 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52771, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 205000
2015-03-13 10:31:52,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:52,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:52,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:52,845 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:52,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:52,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:52,896 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042 src: /127.0.0.1:52772 dest: /127.0.0.1:52451
2015-03-13 10:31:52,898 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042 src: /127.0.0.1:52773 dest: /127.0.0.1:52447
2015-03-13 10:31:52,899 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042 src: /127.0.0.1:52774 dest: /127.0.0.1:52454
2015-03-13 10:31:52,910 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52774, dest: /127.0.0.1:52454, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 8521000
2015-03-13 10:31:52,910 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:52,910 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:52,910 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52773, dest: /127.0.0.1:52447, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 8415000
2015-03-13 10:31:52,911 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:52,911 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:52,911 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52772, dest: /127.0.0.1:52451, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 10099000
2015-03-13 10:31:52,911 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:52,912 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:52,917 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0004_m_000003_0_-259294791_1
2015-03-13 10:31:52,919 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52775, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 222000
2015-03-13 10:31:52,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:31:52,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:31:52,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:31:52,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:31:52,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:31:52,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:52,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:52,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:31:52,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0/part-m-00001-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:52,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:31:52,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:52,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:31:52,995 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000005
2015-03-13 10:31:52,995 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:52,995 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:31:52,995 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000005
2015-03-13 10:31:52,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,997 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:52,997 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:53,000 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:53,009 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000005 is : 143
2015-03-13 10:31:53,011 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:53,012 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044 src: /127.0.0.1:52777 dest: /127.0.0.1:52444
2015-03-13 10:31:53,016 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044 src: /127.0.0.1:52778 dest: /127.0.0.1:52447
2015-03-13 10:31:53,019 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044 src: /127.0.0.1:52779 dest: /127.0.0.1:52454
2015-03-13 10:31:53,024 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist for DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:53,025 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:53,026 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:53,026 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000005
2015-03-13 10:31:53,026 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000005 from application application_1426267835672_0004
2015-03-13 10:31:53,027 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:53,027 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:53,051 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:53,054 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043 src: /127.0.0.1:52776 dest: /127.0.0.1:52447
2015-03-13 10:31:53,057 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043 src: /127.0.0.1:52781 dest: /127.0.0.1:52451
2015-03-13 10:31:53,059 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043 src: /127.0.0.1:52782 dest: /127.0.0.1:52444
2015-03-13 10:31:53,071 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52782, dest: /127.0.0.1:52444, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 10982000
2015-03-13 10:31:53,072 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:53,072 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,072 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52781, dest: /127.0.0.1:52451, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 8337000
2015-03-13 10:31:53,072 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,073 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,073 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52776, dest: /127.0.0.1:52447, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 9712000
2015-03-13 10:31:53,073 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,074 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,078 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,083 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0004_m_000001_0_1807771957_1
2015-03-13 10:31:53,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:31:53,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:31:53,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:31:53,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:31:53,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:31:53,107 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045 src: /127.0.0.1:52780 dest: /127.0.0.1:52447
2015-03-13 10:31:53,109 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045 src: /127.0.0.1:52783 dest: /127.0.0.1:52454
2015-03-13 10:31:53,112 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045 src: /127.0.0.1:52784 dest: /127.0.0.1:52444
2015-03-13 10:31:53,121 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52784, dest: /127.0.0.1:52444, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 7443000
2015-03-13 10:31:53,121 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:53,122 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,122 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52783, dest: /127.0.0.1:52454, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 7399000
2015-03-13 10:31:53,122 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,122 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,123 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52780, dest: /127.0.0.1:52447, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 9647000
2015-03-13 10:31:53,123 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,123 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,128 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0004_m_000000_0_-713004305_1
2015-03-13 10:31:53,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:53,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:31:53,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:31:53,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:31:53,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:31:53,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:31:53,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:31:53,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0/part-m-00001-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:53,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:53,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:53,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:31:53,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:31:53,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0/part-m-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:53,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:31:53,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:31:53,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:31:53,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:53,202 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000003
2015-03-13 10:31:53,202 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:53,202 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:31:53,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,202 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000003
2015-03-13 10:31:53,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:53,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:53,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000005
2015-03-13 10:31:53,204 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:53,204 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:31:53,204 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000005
2015-03-13 10:31:53,204 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:31:53,204 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:31:53,205 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,205 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,205 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:31:53,206 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000005 on node: host: 10.1.1.144:52481 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:31:53,217 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000003 is : 143
2015-03-13 10:31:53,230 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:53,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003
2015-03-13 10:31:53,231 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000002
2015-03-13 10:31:53,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003
2015-03-13 10:31:53,231 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:53,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003
2015-03-13 10:31:53,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:53,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000003
2015-03-13 10:31:53,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:53,233 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:31:53,233 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:53,233 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:53,234 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000002
2015-03-13 10:31:53,246 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000002 is : 143
2015-03-13 10:31:53,259 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000003 from application application_1426267835672_0004
2015-03-13 10:31:53,259 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:53,259 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:53,259 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:53,260 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002
2015-03-13 10:31:53,260 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:53,260 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002
2015-03-13 10:31:53,261 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002
2015-03-13 10:31:53,262 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000002
2015-03-13 10:31:53,262 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:53,262 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:53,263 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000002 from application application_1426267835672_0004
2015-03-13 10:31:53,263 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:53,263 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:53,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046 src: /127.0.0.1:52785 dest: /127.0.0.1:52451
2015-03-13 10:31:53,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046 src: /127.0.0.1:52786 dest: /127.0.0.1:52454
2015-03-13 10:31:53,303 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046 src: /127.0.0.1:52787 dest: /127.0.0.1:52444
2015-03-13 10:31:53,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52787, dest: /127.0.0.1:52444, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 8183000
2015-03-13 10:31:53,313 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:53,314 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,314 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52786, dest: /127.0.0.1:52454, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 8976000
2015-03-13 10:31:53,314 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,314 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,314 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52785, dest: /127.0.0.1:52451, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 9821000
2015-03-13 10:31:53,315 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:53,315 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:53,319 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002 is closed by DFSClient_attempt_1426267835672_0004_m_000002_0_-1058684298_1
2015-03-13 10:31:53,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:31:53,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:31:53,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:31:53,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:31:53,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:31:53,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:53,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:31:53,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0/part-m-00001-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:53,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary/_attempt_1426267835672_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:31:53,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:31:53,400 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000004
2015-03-13 10:31:53,400 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:53,400 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:31:53,401 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000004
2015-03-13 10:31:53,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:53,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000002
2015-03-13 10:31:53,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:53,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000003
2015-03-13 10:31:53,402 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:53,402 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:53,402 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:31:53,402 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000002
2015-03-13 10:31:53,403 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:31:53,403 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:31:53,403 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,403 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,403 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:31:53,403 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000002 on node: host: 10.1.1.144:52481 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:31:53,403 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:53,403 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:31:53,404 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000003
2015-03-13 10:31:53,404 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:31:53,404 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:31:53,404 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:53,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:53,404 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000003 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:31:53,413 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000004 is : 143
2015-03-13 10:31:53,426 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:53,427 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004
2015-03-13 10:31:53,427 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004
2015-03-13 10:31:53,427 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004
2015-03-13 10:31:53,428 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000004
2015-03-13 10:31:53,428 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:53,429 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:53,430 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000004 from application application_1426267835672_0004
2015-03-13 10:31:53,430 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:53,430 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:54,079 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:54,403 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:54,403 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000004
2015-03-13 10:31:54,403 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:54,403 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:31:54,403 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000004
2015-03-13 10:31:54,404 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:54,404 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:54,404 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:54,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:54,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:54,404 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000004 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:54,405 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:54,405 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:54,405 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:31:54,405 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0004 container=Container: [ContainerId: container_1426267835672_0004_01_000006, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0004_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:54,405 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:31:54,405 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:54,974 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045
2015-03-13 10:31:54,974 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042
2015-03-13 10:31:54,975 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043
2015-03-13 10:31:54,988 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045
2015-03-13 10:31:54,989 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046
2015-03-13 10:31:54,989 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043
2015-03-13 10:31:55,084 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:55,212 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046
2015-03-13 10:31:55,212 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043
2015-03-13 10:31:55,213 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042
2015-03-13 10:31:55,313 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:55,322 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0004_01_000006 by user soberoi
2015-03-13 10:31:55,322 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:55,322 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0004_01_000006 to application application_1426267835672_0004
2015-03-13 10:31:55,322 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:31:55,323 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0004
2015-03-13 10:31:55,323 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0004
2015-03-13 10:31:55,323 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:31:55,323 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0004
2015-03-13 10:31:55,324 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:55,347 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045
2015-03-13 10:31:55,347 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046
2015-03-13 10:31:55,347 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042
2015-03-13 10:31:55,348 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:55,348 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:55,407 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:55,408 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:31:55,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006/default_container_executor.sh]
2015-03-13 10:31:56,089 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:56,321 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:31:56,409 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:57,091 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:57,410 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:57,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,742 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0004_r_000000_0_-2143487595_1
2015-03-13 10:31:57,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0	dst=null	perm=null
2015-03-13 10:31:57,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0	dst=null	perm=null
2015-03-13 10:31:57,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/task_1426267835672_0004_r_000000	dst=null	perm=null
2015-03-13 10:31:57,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/_temporary/attempt_1426267835672_0004_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/task_1426267835672_0004_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:31:57,767 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000006
2015-03-13 10:31:57,768 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:57,768 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:31:57,768 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000006
2015-03-13 10:31:57,768 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:31:57,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,777 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,780 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0004_01_000006 is : 143
2015-03-13 10:31:57,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1	dst=null	perm=null
2015-03-13 10:31:57,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:57,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:57,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/task_1426267835672_0004_r_000000	dst=null	perm=null
2015-03-13 10:31:57,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:57,789 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:31:57,789 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:31:57,790 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000006 from application application_1426267835672_0004
2015-03-13 10:31:57,790 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:57,790 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000006
2015-03-13 10:31:57,790 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:31:57,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary/1/task_1426267835672_0004_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary	dst=null	perm=null
2015-03-13 10:31:57,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,800 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,805 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,817 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52779, dest: /127.0.0.1:52454, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, duration: 4796714000
2015-03-13 10:31:57,817 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:57,818 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:57,818 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52778, dest: /127.0.0.1:52447, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, duration: 4797607000
2015-03-13 10:31:57,819 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,819 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:57,820 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52777, dest: /127.0.0.1:52444, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, duration: 4798979000
2015-03-13 10:31:57,820 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,820 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:57,822 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,826 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:57,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047 src: /127.0.0.1:52792 dest: /127.0.0.1:52447
2015-03-13 10:31:57,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047 src: /127.0.0.1:52793 dest: /127.0.0.1:52454
2015-03-13 10:31:57,830 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047 src: /127.0.0.1:52794 dest: /127.0.0.1:52451
2015-03-13 10:31:57,833 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52794, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, duration: 1366000
2015-03-13 10:31:57,833 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:57,834 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:57,834 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52793, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, duration: 1902000
2015-03-13 10:31:57,834 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,835 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:57,835 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52792, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, duration: 2884000
2015-03-13 10:31:57,835 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,836 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:57,837 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist	dst=null	perm=null
2015-03-13 10:31:57,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:31:57,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist	dst=null	perm=null
2015-03-13 10:31:57,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:31:57,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1.jhist	dst=null	perm=null
2015-03-13 10:31:57,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,853 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52795, bytes: 58236, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044, duration: 221000
2015-03-13 10:31:57,855 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:57,856 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048 src: /127.0.0.1:52796 dest: /127.0.0.1:52451
2015-03-13 10:31:57,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048 src: /127.0.0.1:52797 dest: /127.0.0.1:52444
2015-03-13 10:31:57,859 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048 src: /127.0.0.1:52798 dest: /127.0.0.1:52447
2015-03-13 10:31:57,862 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52798, dest: /127.0.0.1:52447, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, duration: 1642000
2015-03-13 10:31:57,862 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:57,863 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:57,863 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52797, dest: /127.0.0.1:52444, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, duration: 2198000
2015-03-13 10:31:57,863 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,863 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:57,864 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52796, dest: /127.0.0.1:52451, bytes: 57784, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, duration: 3741000
2015-03-13 10:31:57,865 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,865 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:57,867 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:57,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:31:57,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:57,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:31:57,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004/job_1426267835672_0004_1_conf.xml	dst=null	perm=null
2015-03-13 10:31:57,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:31:57,879 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52799, bytes: 91498, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741865_1041, duration: 410000
2015-03-13 10:31:57,881 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:57,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049 src: /127.0.0.1:52800 dest: /127.0.0.1:52454
2015-03-13 10:31:57,884 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049 src: /127.0.0.1:52801 dest: /127.0.0.1:52451
2015-03-13 10:31:57,886 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049 src: /127.0.0.1:52802 dest: /127.0.0.1:52444
2015-03-13 10:31:57,889 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52802, dest: /127.0.0.1:52444, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, duration: 1866000
2015-03-13 10:31:57,889 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:57,890 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:57,890 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52801, dest: /127.0.0.1:52451, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, duration: 2425000
2015-03-13 10:31:57,890 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,891 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:57,891 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52800, dest: /127.0.0.1:52454, bytes: 90786, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_718380025_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, duration: 3446000
2015-03-13 10:31:57,891 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:57,892 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:57,894 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_718380025_1
2015-03-13 10:31:57,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:31:57,908 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from RUNNING to FINISHING
2015-03-13 10:31:57,908 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0004
2015-03-13 10:31:57,908 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from RUNNING to REMOVING
2015-03-13 10:31:57,909 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0004
2015-03-13 10:31:57,909 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from REMOVING to FINISHING
2015-03-13 10:31:58,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:58,772 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:31:58,772 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000006
2015-03-13 10:31:58,773 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:31:58,773 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:31:58,773 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000006
2015-03-13 10:31:58,773 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:31:58,773 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:31:58,774 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000006, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:58,774 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:58,774 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:31:58,774 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000006 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:31:58,915 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741861_1037 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52444 
2015-03-13 10:31:58,915 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741862_1038 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52447 
2015-03-13 10:31:58,916 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741863_1039 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444 
2015-03-13 10:31:58,916 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741864_1040 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444 
2015-03-13 10:31:58,916 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741868_1044 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:31:58,916 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741865_1041 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454 
2015-03-13 10:31:58,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0004	dst=null	perm=null
2015-03-13 10:31:58,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:58,947 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary
2015-03-13 10:31:58,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/_temporary	dst=null	perm=null
2015-03-13 10:31:58,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:58,949 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary
2015-03-13 10:31:58,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:58,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:58,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:58,951 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary
2015-03-13 10:31:58,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/_temporary	dst=null	perm=null
2015-03-13 10:31:58,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:58,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:58,961 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:58,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:58,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:58,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:58,964 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:58,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:58,975 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:58,975 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:58,976 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:58,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:58,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:58,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:58,980 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:31:58,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:31:58,983 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52804, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 198000
2015-03-13 10:31:58,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:31:58,986 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52805, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 204000
2015-03-13 10:31:58,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:31:58,989 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52805, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 159000
2015-03-13 10:31:58,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:31:58,991 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52805, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 180000
2015-03-13 10:31:58,991 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/all/tap
2015-03-13 10:31:58,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:58,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:58,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:58,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap	dst=null	perm=null
2015-03-13 10:31:58,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:58,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/tap/part-00000	dst=null	perm=null
2015-03-13 10:31:58,998 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/all/trap
2015-03-13 10:31:58,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:58,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:59,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:59,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap	dst=null	perm=null
2015-03-13 10:31:59,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:31:59,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:31:59,005 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52806, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741869_1045, duration: 208000
2015-03-13 10:31:59,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:31:59,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:31:59,009 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52807, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741867_1043, duration: 192000
2015-03-13 10:31:59,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:31:59,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:31:59,014 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52807, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741870_1046, duration: 194000
2015-03-13 10:31:59,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:31:59,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/all/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:31:59,018 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52805, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741866_1042, duration: 178000
2015-03-13 10:31:59,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:59,033 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:59,034 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:31:59,035 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:31:59,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:31:59,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:31:59,048 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:31:59,048 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["HadoopFailScheme[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:31:59,048 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["HadoopFailScheme[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink"]
2015-03-13 10:31:59,049 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:31:59,049 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:31:59,049 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:31:59,049 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...tform/trapsourcesink/sink
2015-03-13 10:31:59,057 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:59,068 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:59,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:31:59,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:59,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:31:59,074 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 5
2015-03-13 10:31:59,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005	dst=null	perm=null
2015-03-13 10:31:59,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:31:59,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:31:59,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:31:59,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,081 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:31:59,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52809 dest: /127.0.0.1:52447
2015-03-13 10:31:59,083 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52810 dest: /127.0.0.1:52451
2015-03-13 10:31:59,084 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52811 dest: /127.0.0.1:52444
2015-03-13 10:31:59,089 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52811, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 2970000
2015-03-13 10:31:59,089 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:59,090 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:59,090 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52810, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 3548000
2015-03-13 10:31:59,090 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,090 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:59,091 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52809, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 4768000
2015-03-13 10:31:59,091 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,092 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:31:59,093 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:59,093 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar
2015-03-13 10:31:59,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:31:59,094 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:31:59,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:59,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:59,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:59,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:31:59,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:31:59,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:31:59,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:31:59,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:31:59,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:59,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:59,102 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:31:59,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:31:59,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,107 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split
2015-03-13 10:31:59,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=null
2015-03-13 10:31:59,108 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:31:59,110 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051 src: /127.0.0.1:52812 dest: /127.0.0.1:52444
2015-03-13 10:31:59,111 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051 src: /127.0.0.1:52813 dest: /127.0.0.1:52454
2015-03-13 10:31:59,113 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051 src: /127.0.0.1:52814 dest: /127.0.0.1:52451
2015-03-13 10:31:59,114 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051 src: /127.0.0.1:52815 dest: /127.0.0.1:52447
2015-03-13 10:31:59,118 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52815, dest: /127.0.0.1:52447, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 2565000
2015-03-13 10:31:59,119 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:59,119 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:59,119 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52814, dest: /127.0.0.1:52451, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 2997000
2015-03-13 10:31:59,119 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,120 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:59,120 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52813, dest: /127.0.0.1:52454, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 4076000
2015-03-13 10:31:59,120 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,121 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52812, dest: /127.0.0.1:52444, bytes: 366, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 4652000
2015-03-13 10:31:59,121 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:59,121 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,121 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:31:59,123 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:59,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,128 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:31:59,129 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052 src: /127.0.0.1:52816 dest: /127.0.0.1:52451
2015-03-13 10:31:59,131 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052 src: /127.0.0.1:52817 dest: /127.0.0.1:52447
2015-03-13 10:31:59,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052 src: /127.0.0.1:52818 dest: /127.0.0.1:52454
2015-03-13 10:31:59,135 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52818, dest: /127.0.0.1:52454, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 1307000
2015-03-13 10:31:59,135 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:59,136 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:59,136 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52817, dest: /127.0.0.1:52447, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 1884000
2015-03-13 10:31:59,136 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,137 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:59,137 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52816, dest: /127.0.0.1:52451, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 2973000
2015-03-13 10:31:59,137 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,138 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:31:59,139 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:59,139 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-03-13 10:31:59,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:31:59,143 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:31:59,144 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:31:59,144 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:31:59,179 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:31:59,180 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053 src: /127.0.0.1:52819 dest: /127.0.0.1:52447
2015-03-13 10:31:59,182 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053 src: /127.0.0.1:52820 dest: /127.0.0.1:52444
2015-03-13 10:31:59,183 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053 src: /127.0.0.1:52821 dest: /127.0.0.1:52451
2015-03-13 10:31:59,189 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52821, dest: /127.0.0.1:52451, bytes: 98092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 4661000
2015-03-13 10:31:59,190 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:31:59,190 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:59,190 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52820, dest: /127.0.0.1:52444, bytes: 98092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 5145000
2015-03-13 10:31:59,190 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,191 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:59,191 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52819, dest: /127.0.0.1:52447, bytes: 98092, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 5976000
2015-03-13 10:31:59,191 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:31:59,192 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:31:59,193 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:31:59,194 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0005
2015-03-13 10:31:59,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005	dst=null	perm=null
2015-03-13 10:31:59,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:31:59,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:31:59,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:31:59,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:31:59,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=null
2015-03-13 10:31:59,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=null
2015-03-13 10:31:59,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:59,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:59,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:59,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:59,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:59,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:59,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:31:59,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:31:59,207 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 5 submitted by user soberoi
2015-03-13 10:31:59,207 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0005
2015-03-13 10:31:59,207 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0005
2015-03-13 10:31:59,207 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0005
2015-03-13 10:31:59,207 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from NEW to NEW_SAVING
2015-03-13 10:31:59,208 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:31:59,208 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0005_000001
2015-03-13 10:31:59,208 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from NEW to SUBMITTED
2015-03-13 10:31:59,208 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0005 from user: soberoi activated in queue: default
2015-03-13 10:31:59,208 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0005 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:31:59,208 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0005 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:31:59,209 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0005_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:31:59,209 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0005 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:31:59,209 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:31:59,209 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from SUBMITTED to ACCEPTED
2015-03-13 10:31:59,211 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0005/
2015-03-13 10:31:59,212 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0005
2015-03-13 10:31:59,212 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0005/
2015-03-13 10:31:59,479 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:31:59,480 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000001
2015-03-13 10:31:59,480 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:31:59,480 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0005 container=Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0005_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:59,480 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:31:59,480 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:31:59,480 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:31:59,481 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0005 AttemptId: appattempt_1426267835672_0005_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ]
2015-03-13 10:31:59,482 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:31:59,482 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0005_000001
2015-03-13 10:31:59,482 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:31:59,483 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0005_000001
2015-03-13 10:31:59,483 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] for AM appattempt_1426267835672_0005_000001
2015-03-13 10:31:59,484 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0005_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:31:59,486 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0005_000001 (auth:SIMPLE)
2015-03-13 10:31:59,488 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0005_01_000001 by user soberoi
2015-03-13 10:31:59,488 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0005
2015-03-13 10:31:59,489 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000001
2015-03-13 10:31:59,489 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from NEW to INITING
2015-03-13 10:31:59,489 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0005_01_000001 to application application_1426267835672_0005
2015-03-13 10:31:59,489 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from INITING to RUNNING
2015-03-13 10:31:59,489 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] for AM appattempt_1426267835672_0005_000001
2015-03-13 10:31:59,489 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:31:59,489 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:31:59,490 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0005
2015-03-13 10:31:59,490 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:31:59,490 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:31:59,490 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:31:59,490 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:31:59,490 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0005_01_000001
2015-03-13 10:31:59,499 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426267835672_0005_01_000001.tokens. Credentials list: 
2015-03-13 10:31:59,515 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:31:59,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426267835672_0005_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001.tokens
2015-03-13 10:31:59,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:31:59,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:31:59,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:31:59,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:31:59,659 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52804, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1733760469_2721, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 515000
2015-03-13 10:31:59,678 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:59,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:59,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:59,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:31:59,700 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52804, bytes: 49, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1733760469_2721, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 177000
2015-03-13 10:31:59,713 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:59,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=null
2015-03-13 10:31:59,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=null
2015-03-13 10:31:59,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=null
2015-03-13 10:31:59,736 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52807, bytes: 370, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1733760469_2721, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 173000
2015-03-13 10:31:59,748 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:59,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:31:59,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:31:59,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:31:59,771 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52807, bytes: 98860, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1733760469_2721, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 311000
2015-03-13 10:31:59,783 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:31:59,783 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:31:59,811 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:31:59,811 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:31:59,877 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001/default_container_executor.sh]
2015-03-13 10:31:59,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044
2015-03-13 10:31:59,978 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048
2015-03-13 10:31:59,978 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047
2015-03-13 10:31:59,979 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053
2015-03-13 10:31:59,979 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052
2015-03-13 10:31:59,994 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050
2015-03-13 10:32:00,095 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:00,198 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048
2015-03-13 10:32:00,199 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049
2015-03-13 10:32:00,199 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044
2015-03-13 10:32:00,200 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051
2015-03-13 10:32:00,219 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047
2015-03-13 10:32:00,219 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053
2015-03-13 10:32:00,220 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049
2015-03-13 10:32:00,353 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741873_1049
2015-03-13 10:32:00,353 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052
2015-03-13 10:32:00,354 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741868_1044
2015-03-13 10:32:00,354 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047
2015-03-13 10:32:00,355 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051
2015-03-13 10:32:00,379 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050
2015-03-13 10:32:00,379 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051
2015-03-13 10:32:00,394 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053
2015-03-13 10:32:00,419 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741872_1048
2015-03-13 10:32:00,479 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:00,480 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:00,620 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050
2015-03-13 10:32:00,620 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052
2015-03-13 10:32:00,621 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051
2015-03-13 10:32:00,912 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741874_1050 to datanode(s) 127.0.0.1:52454
2015-03-13 10:32:00,912 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741868_1044]
2015-03-13 10:32:00,912 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741865_1041, blk_1073741868_1044]
2015-03-13 10:32:01,097 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:01,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:01,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:32:01,483 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:01,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:32:01,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:32:01,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005	dst=null	perm=null
2015-03-13 10:32:01,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:32:01,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:32:01,603 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861 for deletion
2015-03-13 10:32:01,603 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862 for deletion
2015-03-13 10:32:01,603 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863 for deletion
2015-03-13 10:32:01,603 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864 for deletion
2015-03-13 10:32:01,604 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868 for deletion
2015-03-13 10:32:01,604 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861
2015-03-13 10:32:01,604 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863
2015-03-13 10:32:01,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862
2015-03-13 10:32:01,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864
2015-03-13 10:32:01,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868
2015-03-13 10:32:01,606 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 to 127.0.0.1:52454 
2015-03-13 10:32:01,606 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861 for deletion
2015-03-13 10:32:01,606 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862 for deletion
2015-03-13 10:32:01,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863 for deletion
2015-03-13 10:32:01,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864 for deletion
2015-03-13 10:32:01,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865 for deletion
2015-03-13 10:32:01,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868 for deletion
2015-03-13 10:32:01,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862
2015-03-13 10:32:01,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864
2015-03-13 10:32:01,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865
2015-03-13 10:32:01,609 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:32:01,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861
2015-03-13 10:32:01,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863
2015-03-13 10:32:01,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868
2015-03-13 10:32:01,611 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52826 dest: /127.0.0.1:52454
2015-03-13 10:32:01,613 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050 src: /127.0.0.1:52826 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:32:01,614 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741874_1050 size 254067
2015-03-13 10:32:01,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:01,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:01,880 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52827, bytes: 49, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741876_1052, duration: 207000
2015-03-13 10:32:02,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:02,487 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:02,633 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0005_000001 (auth:SIMPLE)
2015-03-13 10:32:02,635 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0005_000001
2015-03-13 10:32:02,635 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0005	APPATTEMPTID=appattempt_1426267835672_0005_000001
2015-03-13 10:32:02,635 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:32:02,635 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from ACCEPTED to RUNNING
2015-03-13 10:32:02,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:02,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:02,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:02,854 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:02,891 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054 src: /127.0.0.1:52833 dest: /127.0.0.1:52451
2015-03-13 10:32:02,893 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054 src: /127.0.0.1:52834 dest: /127.0.0.1:52447
2015-03-13 10:32:02,894 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054 src: /127.0.0.1:52835 dest: /127.0.0.1:52444
2015-03-13 10:32:02,902 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52835, dest: /127.0.0.1:52444, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, duration: 5962000
2015-03-13 10:32:02,902 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:02,903 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:02,903 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52834, dest: /127.0.0.1:52447, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, duration: 6614000
2015-03-13 10:32:02,903 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:02,904 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52833, dest: /127.0.0.1:52451, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, duration: 7611000
2015-03-13 10:32:02,904 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:02,904 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:02,905 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:02,911 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:03,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:03,492 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:03,794 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:03,794 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:03,795 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:03,795 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0005 container=Container: [ContainerId: container_1426267835672_0005_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0005_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:03,795 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:32:03,795 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:03,917 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741865_1041]
2015-03-13 10:32:03,918 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741861_1037, blk_1073741862_1038, blk_1073741863_1039, blk_1073741864_1040, blk_1073741865_1041, blk_1073741868_1044]
2015-03-13 10:32:04,050 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0004_01_000001 succeeded 
2015-03-13 10:32:04,050 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:32:04,050 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0004_01_000001
2015-03-13 10:32:04,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001
2015-03-13 10:32:04,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001
2015-03-13 10:32:04,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001
2015-03-13 10:32:04,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0004/container_1426267835672_0004_01_000001
2015-03-13 10:32:04,059 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000001
2015-03-13 10:32:04,059 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0004_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:32:04,059 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0004_01_000001 from application application_1426267835672_0004
2015-03-13 10:32:04,059 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:04,059 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0004
2015-03-13 10:32:04,108 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:32:04,108 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0004_01_000001
2015-03-13 10:32:04,109 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0004_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:04,109 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0004_000001
2015-03-13 10:32:04,109 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0004_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:32:04,109 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0004_000001 State change from FINISHING to FINISHED
2015-03-13 10:32:04,109 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0004	CONTAINERID=container_1426267835672_0004_01_000001
2015-03-13 10:32:04,110 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0004 State change from FINISHING to FINISHED
2015-03-13 10:32:04,110 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:04,110 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0004
2015-03-13 10:32:04,110 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:32:04,110 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0004,name=[556A3EF415294468966B68292BE360F8/1F24603F771643C9A3DB4171C3FE2709] trap test/(1/1) ...-mr1/trapplatform/all/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0004/jobhistory/job/job_1426267835672_0004,appMasterHost=Edinburgh.local,startTime=1426267899477,finishTime=1426267917909,finalStatus=SUCCEEDED
2015-03-13 10:32:04,111 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0004_000001
2015-03-13 10:32:04,111 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0004_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:04,111 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:04,111 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:32:04,111 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0004_000001 released container container_1426267835672_0004_01_000001 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:04,112 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0004_000001 is done. finalState=FINISHED
2015-03-13 10:32:04,112 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0004 requests cleared
2015-03-13 10:32:04,112 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0004 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:32:04,112 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0004 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:32:04,114 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0004_000001 (auth:SIMPLE)
2015-03-13 10:32:04,116 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0004_01_000001
2015-03-13 10:32:04,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:04,666 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:04,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:32:04,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:32:04,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:32:04,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:32:04,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:04,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:04,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:04,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:04,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:04,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:04,778 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0005_000001 (auth:SIMPLE)
2015-03-13 10:32:04,781 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0005_01_000002 by user soberoi
2015-03-13 10:32:04,781 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0005
2015-03-13 10:32:04,781 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:04,781 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from NEW to INITING
2015-03-13 10:32:04,781 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0005_01_000002 to application application_1426267835672_0005
2015-03-13 10:32:04,782 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from INITING to RUNNING
2015-03-13 10:32:04,782 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:32:04,782 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0005
2015-03-13 10:32:04,782 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0005
2015-03-13 10:32:04,782 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:04,782 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0005
2015-03-13 10:32:04,783 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:04,783 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:04,783 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0005_01_000002
2015-03-13 10:32:04,793 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0005_01_000002.tokens. Credentials list: 
2015-03-13 10:32:04,794 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:04,794 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:04,794 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:04,795 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:04,795 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0004
2015-03-13 10:32:04,795 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:04,795 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:04,796 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:04,795 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:04,796 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0004, with delay of 10800 seconds
2015-03-13 10:32:04,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861 for deletion
2015-03-13 10:32:04,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862 for deletion
2015-03-13 10:32:04,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865 for deletion
2015-03-13 10:32:04,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861
2015-03-13 10:32:04,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862
2015-03-13 10:32:04,811 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:04,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865
2015-03-13 10:32:04,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0005_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002.tokens
2015-03-13 10:32:04,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:04,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:32:04,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:32:04,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar	dst=null	perm=null
2015-03-13 10:32:04,954 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861 for deletion
2015-03-13 10:32:04,954 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862 for deletion
2015-03-13 10:32:04,954 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863 for deletion
2015-03-13 10:32:04,954 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741861
2015-03-13 10:32:04,954 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864 for deletion
2015-03-13 10:32:04,954 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741862_1038 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741862
2015-03-13 10:32:04,954 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865 for deletion
2015-03-13 10:32:04,955 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868 for deletion
2015-03-13 10:32:04,954 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741863_1039 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741863
2015-03-13 10:32:04,955 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741864_1040 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741864
2015-03-13 10:32:04,955 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741865_1041 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741865
2015-03-13 10:32:04,955 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741868_1044 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741868
2015-03-13 10:32:04,956 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52840, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1229307756_2825, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050, duration: 520000
2015-03-13 10:32:04,974 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:04,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:32:04,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:32:04,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml	dst=null	perm=null
2015-03-13 10:32:04,998 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52841, bytes: 98860, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1229307756_2825, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741877_1053, duration: 319000
2015-03-13 10:32:05,011 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:05,011 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:05,036 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:05,036 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:05,104 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002/default_container_executor.sh]
2015-03-13 10:32:05,109 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:05,110 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:05,110 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0004
2015-03-13 10:32:05,110 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:05,110 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:05,110 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0004, with delay of 10800 seconds
2015-03-13 10:32:05,110 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:05,111 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0004
2015-03-13 10:32:05,360 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741874_1050
2015-03-13 10:32:05,383 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054
2015-03-13 10:32:05,400 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054
2015-03-13 10:32:05,497 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:05,624 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054
2015-03-13 10:32:05,681 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:32:05,799 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:06,502 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:06,802 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:07,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job.split	dst=null	perm=null
2015-03-13 10:32:07,265 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52844, bytes: 370, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741875_1051, duration: 153000
2015-03-13 10:32:07,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:07,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary	dst=null	perm=null
2015-03-13 10:32:07,504 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:07,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:07,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:07,688 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52844, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 189000
2015-03-13 10:32:07,698 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:07,728 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055 src: /127.0.0.1:52845 dest: /127.0.0.1:52447
2015-03-13 10:32:07,730 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055 src: /127.0.0.1:52846 dest: /127.0.0.1:52451
2015-03-13 10:32:07,731 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055 src: /127.0.0.1:52847 dest: /127.0.0.1:52454
2015-03-13 10:32:07,737 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52847, dest: /127.0.0.1:52454, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 4410000
2015-03-13 10:32:07,737 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:07,738 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52846, dest: /127.0.0.1:52451, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 5149000
2015-03-13 10:32:07,738 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:07,738 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:07,740 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52845, dest: /127.0.0.1:52447, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 6648000
2015-03-13 10:32:07,740 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:07,741 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:07,742 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:07,745 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0005_m_000000_0_-1872052276_1
2015-03-13 10:32:07,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0	dst=null	perm=null
2015-03-13 10:32:07,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0	dst=null	perm=null
2015-03-13 10:32:07,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0	dst=null	perm=null
2015-03-13 10:32:07,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0	dst=null	perm=null
2015-03-13 10:32:07,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0	dst=null	perm=null
2015-03-13 10:32:07,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:07,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:32:07,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0/part-m-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-m-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:07,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_m_000000_0	dst=null	perm=null
2015-03-13 10:32:07,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_m_000000_0	dst=null	perm=null
2015-03-13 10:32:07,804 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:07,806 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0005_01_000002
2015-03-13 10:32:07,807 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:07,807 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:32:07,807 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0005_01_000002
2015-03-13 10:32:07,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:07,820 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0005_01_000002 is : 143
2015-03-13 10:32:07,824 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:07,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056 src: /127.0.0.1:52848 dest: /127.0.0.1:52447
2015-03-13 10:32:07,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056 src: /127.0.0.1:52849 dest: /127.0.0.1:52454
2015-03-13 10:32:07,830 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056 src: /127.0.0.1:52850 dest: /127.0.0.1:52444
2015-03-13 10:32:07,833 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:07,833 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002
2015-03-13 10:32:07,834 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002
2015-03-13 10:32:07,834 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002
2015-03-13 10:32:07,834 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000002
2015-03-13 10:32:07,834 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:07,835 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:07,835 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0005_01_000002 from application application_1426267835672_0005
2015-03-13 10:32:07,835 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:07,835 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0005
2015-03-13 10:32:07,836 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist for DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:08,509 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:08,810 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:08,810 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0005_01_000002
2015-03-13 10:32:08,811 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:08,811 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0005_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:32:08,812 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000002
2015-03-13 10:32:08,812 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:08,812 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:08,812 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0005_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:08,812 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:08,813 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:08,813 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0005_000001 released container container_1426267835672_0005_01_000002 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:09,511 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:09,812 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:09,813 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:09,813 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:09,813 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0005 container=Container: [ContainerId: container_1426267835672_0005_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0005_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:09,813 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:32:09,813 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:10,364 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055
2015-03-13 10:32:10,389 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055
2015-03-13 10:32:10,512 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:10,627 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055
2015-03-13 10:32:10,710 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:10,718 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0005_01_000003 by user soberoi
2015-03-13 10:32:10,719 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:10,719 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0005_01_000003 to application application_1426267835672_0005
2015-03-13 10:32:10,719 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:32:10,719 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0005
2015-03-13 10:32:10,719 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0005
2015-03-13 10:32:10,719 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:10,719 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0005
2015-03-13 10:32:10,720 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:10,745 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:10,745 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:10,813 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:10,813 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:10,814 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003/default_container_executor.sh]
2015-03-13 10:32:11,515 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:11,716 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:32:11,813 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:12,516 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:12,819 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:13,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary	dst=null	perm=null
2015-03-13 10:32:13,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,210 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:13,265 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057 src: /127.0.0.1:52854 dest: /127.0.0.1:52454
2015-03-13 10:32:13,266 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057 src: /127.0.0.1:52855 dest: /127.0.0.1:52447
2015-03-13 10:32:13,268 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057 src: /127.0.0.1:52856 dest: /127.0.0.1:52444
2015-03-13 10:32:13,280 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52856, dest: /127.0.0.1:52444, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 10661000
2015-03-13 10:32:13,280 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,280 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,280 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52855, dest: /127.0.0.1:52447, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 11161000
2015-03-13 10:32:13,281 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,281 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,282 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52854, dest: /127.0.0.1:52454, bytes: 9, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 12336000
2015-03-13 10:32:13,283 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,283 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,286 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1
2015-03-13 10:32:13,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:32:13,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:32:13,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:32:13,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:32:13,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:32:13,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:13,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:32:13,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0/part-r-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-r-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary/_attempt_1426267835672_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:32:13,317 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:13,319 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058 src: /127.0.0.1:52857 dest: /127.0.0.1:52444
2015-03-13 10:32:13,321 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058 src: /127.0.0.1:52858 dest: /127.0.0.1:52451
2015-03-13 10:32:13,323 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058 src: /127.0.0.1:52859 dest: /127.0.0.1:52454
2015-03-13 10:32:13,326 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52859, dest: /127.0.0.1:52454, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 1459000
2015-03-13 10:32:13,326 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,327 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,327 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52858, dest: /127.0.0.1:52451, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 2109000
2015-03-13 10:32:13,327 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,328 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,328 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52857, dest: /127.0.0.1:52444, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 3169000
2015-03-13 10:32:13,328 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,329 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,330 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0005_r_000000_0_-1620842375_1
2015-03-13 10:32:13,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:32:13,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:32:13,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/task_1426267835672_0005_r_000000	dst=null	perm=null
2015-03-13 10:32:13,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/_temporary/attempt_1426267835672_0005_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/task_1426267835672_0005_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:13,351 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0005_01_000003
2015-03-13 10:32:13,351 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:13,351 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:32:13,351 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0005_01_000003
2015-03-13 10:32:13,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:13,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,359 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1	dst=null	perm=null
2015-03-13 10:32:13,363 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0005_01_000003 is : 143
2015-03-13 10:32:13,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:13,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:13,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/task_1426267835672_0005_r_000000	dst=null	perm=null
2015-03-13 10:32:13,372 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:13,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000	dst=null	perm=null
2015-03-13 10:32:13,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003
2015-03-13 10:32:13,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003
2015-03-13 10:32:13,373 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:13,373 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:13,373 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0005_01_000003 from application application_1426267835672_0005
2015-03-13 10:32:13,373 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:13,373 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0005
2015-03-13 10:32:13,374 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003
2015-03-13 10:32:13,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000003
2015-03-13 10:32:13,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary/1/task_1426267835672_0005_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary	dst=null	perm=null
2015-03-13 10:32:13,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,385 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,388 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,401 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52850, dest: /127.0.0.1:52444, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, duration: 5569115000
2015-03-13 10:32:13,401 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,402 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,402 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52849, dest: /127.0.0.1:52454, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, duration: 5569779000
2015-03-13 10:32:13,402 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,403 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,403 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52848, dest: /127.0.0.1:52447, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, duration: 5571274000
2015-03-13 10:32:13,403 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,404 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:13,405 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,409 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:13,411 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059 src: /127.0.0.1:52860 dest: /127.0.0.1:52444
2015-03-13 10:32:13,413 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059 src: /127.0.0.1:52861 dest: /127.0.0.1:52447
2015-03-13 10:32:13,414 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059 src: /127.0.0.1:52862 dest: /127.0.0.1:52451
2015-03-13 10:32:13,417 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52862, dest: /127.0.0.1:52451, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, duration: 1743000
2015-03-13 10:32:13,417 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,418 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,418 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52861, dest: /127.0.0.1:52447, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, duration: 2142000
2015-03-13 10:32:13,418 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,419 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,419 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52860, dest: /127.0.0.1:52444, bytes: 452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, duration: 3173000
2015-03-13 10:32:13,419 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,420 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,421 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist	dst=null	perm=null
2015-03-13 10:32:13,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:32:13,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist	dst=null	perm=null
2015-03-13 10:32:13,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:32:13,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1.jhist	dst=null	perm=null
2015-03-13 10:32:13,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,440 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52863, bytes: 37480, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056, duration: 194000
2015-03-13 10:32:13,441 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:13,443 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060 src: /127.0.0.1:52864 dest: /127.0.0.1:52447
2015-03-13 10:32:13,444 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060 src: /127.0.0.1:52865 dest: /127.0.0.1:52444
2015-03-13 10:32:13,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060 src: /127.0.0.1:52866 dest: /127.0.0.1:52454
2015-03-13 10:32:13,448 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52866, dest: /127.0.0.1:52454, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, duration: 1755000
2015-03-13 10:32:13,448 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,449 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52865, dest: /127.0.0.1:52444, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, duration: 2288000
2015-03-13 10:32:13,449 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,449 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52864, dest: /127.0.0.1:52447, bytes: 37188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, duration: 3160000
2015-03-13 10:32:13,450 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,450 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:13,451 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:13,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:32:13,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:13,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:32:13,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005/job_1426267835672_0005_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:13,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:13,466 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52867, bytes: 91390, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741878_1054, duration: 355000
2015-03-13 10:32:13,468 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:13,470 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061 src: /127.0.0.1:52868 dest: /127.0.0.1:52444
2015-03-13 10:32:13,471 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061 src: /127.0.0.1:52869 dest: /127.0.0.1:52454
2015-03-13 10:32:13,472 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061 src: /127.0.0.1:52870 dest: /127.0.0.1:52451
2015-03-13 10:32:13,476 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52870, dest: /127.0.0.1:52451, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, duration: 2067000
2015-03-13 10:32:13,476 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:13,476 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,477 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52869, dest: /127.0.0.1:52454, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, duration: 2741000
2015-03-13 10:32:13,477 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,477 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,477 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52868, dest: /127.0.0.1:52444, bytes: 90678, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-741611367_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, duration: 3649000
2015-03-13 10:32:13,478 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:13,478 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:13,480 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-741611367_1
2015-03-13 10:32:13,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:13,493 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from RUNNING to FINISHING
2015-03-13 10:32:13,493 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0005
2015-03-13 10:32:13,494 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from RUNNING to REMOVING
2015-03-13 10:32:13,494 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0005
2015-03-13 10:32:13,494 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from REMOVING to FINISHING
2015-03-13 10:32:13,517 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:14,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:14,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0005_01_000003
2015-03-13 10:32:14,353 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:14,353 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0005_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:32:14,353 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000003
2015-03-13 10:32:14,353 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:14,353 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:14,353 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0005_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:14,353 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:14,354 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:14,354 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0005_000001 released container container_1426267835672_0005_01_000003 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:14,505 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741874_1050 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:32:14,505 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741875_1051 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52447 
2015-03-13 10:32:14,506 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741876_1052 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:32:14,506 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741877_1053 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52451 
2015-03-13 10:32:14,506 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741880_1056 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444 
2015-03-13 10:32:14,506 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741878_1054 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52444 
2015-03-13 10:32:14,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0005	dst=null	perm=null
2015-03-13 10:32:14,518 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:14,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:14,535 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary
2015-03-13 10:32:14,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/_temporary	dst=null	perm=null
2015-03-13 10:32:14,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,537 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary
2015-03-13 10:32:14,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary	dst=null	perm=null
2015-03-13 10:32:14,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary	dst=null	perm=null
2015-03-13 10:32:14,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,539 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary
2015-03-13 10:32:14,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/_temporary	dst=null	perm=null
2015-03-13 10:32:14,548 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:14,548 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:14,549 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:14,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:14,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:14,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:14,552 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:14,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000	dst=null	perm=null
2015-03-13 10:32:14,555 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52872, bytes: 116, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 185000
2015-03-13 10:32:14,562 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:14,562 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:14,563 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:14,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,567 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 2
2015-03-13 10:32:14,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:32:14,570 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52873, bytes: 13, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 167000
2015-03-13 10:32:14,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:32:14,573 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52874, bytes: 13, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 171000
2015-03-13 10:32:14,573 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/trapsourcesink/trap
2015-03-13 10:32:14,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap	dst=null	perm=null
2015-03-13 10:32:14,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:32:14,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:32:14,579 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52874, bytes: 13, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741879_1055, duration: 178000
2015-03-13 10:32:14,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:32:14,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:32:14,582 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52873, bytes: 13, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057, duration: 200000
2015-03-13 10:32:14,582 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/trapsourcesink/sink
2015-03-13 10:32:14,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:14,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:14,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:14,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink	dst=null	perm=null
2015-03-13 10:32:14,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000	dst=null	perm=null
2015-03-13 10:32:14,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/trapsourcesink/sink/part-00000	dst=null	perm=null
2015-03-13 10:32:14,587 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52872, bytes: 116, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058, duration: 177000
2015-03-13 10:32:14,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:14,598 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:14,599 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:32:14,599 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:32:14,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:14,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:14,614 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:32:14,614 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:32:14,614 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap"]
2015-03-13 10:32:14,615 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:32:14,615 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:32:14,615 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:32:14,616 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...latform/everycomplete/tap
2015-03-13 10:32:14,629 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:14,641 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:14,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:14,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:14,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:14,646 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 6
2015-03-13 10:32:14,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006	dst=null	perm=null
2015-03-13 10:32:14,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:32:14,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:32:14,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:14,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,653 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:14,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52876 dest: /127.0.0.1:52451
2015-03-13 10:32:14,656 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52877 dest: /127.0.0.1:52447
2015-03-13 10:32:14,657 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52878 dest: /127.0.0.1:52444
2015-03-13 10:32:14,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52878, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 1936000
2015-03-13 10:32:14,661 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:14,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52877, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 2789000
2015-03-13 10:32:14,661 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:14,661 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,662 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52876, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 3649000
2015-03-13 10:32:14,662 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,662 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:14,665 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:14,668 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:14,669 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar
2015-03-13 10:32:14,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:14,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:14,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:14,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:14,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:32:14,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:32:14,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:32:14,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:32:14,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:32:14,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:14,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:14,683 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:14,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:14,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,690 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split
2015-03-13 10:32:14,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:14,692 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:14,693 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063 src: /127.0.0.1:52879 dest: /127.0.0.1:52444
2015-03-13 10:32:14,694 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063 src: /127.0.0.1:52880 dest: /127.0.0.1:52447
2015-03-13 10:32:14,695 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063 src: /127.0.0.1:52881 dest: /127.0.0.1:52451
2015-03-13 10:32:14,696 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063 src: /127.0.0.1:52882 dest: /127.0.0.1:52454
2015-03-13 10:32:14,700 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52882, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 2629000
2015-03-13 10:32:14,700 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:14,700 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,700 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52881, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 3175000
2015-03-13 10:32:14,701 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,701 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,701 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52880, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 3930000
2015-03-13 10:32:14,701 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,702 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,702 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52879, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 4656000
2015-03-13 10:32:14,702 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,703 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,705 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:14,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,709 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:14,711 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064 src: /127.0.0.1:52883 dest: /127.0.0.1:52447
2015-03-13 10:32:14,713 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064 src: /127.0.0.1:52884 dest: /127.0.0.1:52444
2015-03-13 10:32:14,714 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064 src: /127.0.0.1:52885 dest: /127.0.0.1:52454
2015-03-13 10:32:14,717 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52885, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 1529000
2015-03-13 10:32:14,718 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:14,718 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,718 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52884, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 2034000
2015-03-13 10:32:14,719 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,719 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,719 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52883, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 3116000
2015-03-13 10:32:14,720 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,721 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:14,722 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:14,723 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:32:14,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:14,728 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:14,729 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:14,729 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:14,737 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:14,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065 src: /127.0.0.1:52886 dest: /127.0.0.1:52447
2015-03-13 10:32:14,740 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065 src: /127.0.0.1:52887 dest: /127.0.0.1:52444
2015-03-13 10:32:14,742 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065 src: /127.0.0.1:52888 dest: /127.0.0.1:52451
2015-03-13 10:32:14,744 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52888, dest: /127.0.0.1:52451, bytes: 98164, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 1304000
2015-03-13 10:32:14,745 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:14,745 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:14,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52887, dest: /127.0.0.1:52444, bytes: 98164, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 1858000
2015-03-13 10:32:14,745 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,746 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:14,746 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52886, dest: /127.0.0.1:52447, bytes: 98164, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 2735000
2015-03-13 10:32:14,746 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:14,747 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:14,749 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:14,749 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0006
2015-03-13 10:32:14,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006	dst=null	perm=null
2015-03-13 10:32:14,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:14,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:14,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:14,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:14,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:14,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:14,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:14,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:14,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:14,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:14,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:14,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:14,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:14,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:14,765 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 6 submitted by user soberoi
2015-03-13 10:32:14,765 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0006
2015-03-13 10:32:14,766 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0006
2015-03-13 10:32:14,766 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0006
2015-03-13 10:32:14,766 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from NEW to NEW_SAVING
2015-03-13 10:32:14,766 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:32:14,766 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0006_000001
2015-03-13 10:32:14,767 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from NEW to SUBMITTED
2015-03-13 10:32:14,767 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0006 from user: soberoi activated in queue: default
2015-03-13 10:32:14,767 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0006 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:32:14,767 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0006 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:32:14,767 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0006_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:32:14,767 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0006 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:14,767 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:32:14,768 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from SUBMITTED to ACCEPTED
2015-03-13 10:32:14,770 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0006/
2015-03-13 10:32:14,771 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0006
2015-03-13 10:32:14,771 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0006/
2015-03-13 10:32:15,138 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:15,138 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000001
2015-03-13 10:32:15,138 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:32:15,139 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0006_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:15,139 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:32:15,139 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:15,139 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:15,140 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0006 AttemptId: appattempt_1426267835672_0006_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:32:15,140 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:32:15,140 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0006_000001
2015-03-13 10:32:15,141 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:32:15,141 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0006_000001
2015-03-13 10:32:15,142 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0006_000001
2015-03-13 10:32:15,142 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0006_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:32:15,144 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:15,146 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000001 by user soberoi
2015-03-13 10:32:15,147 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0006
2015-03-13 10:32:15,147 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000001
2015-03-13 10:32:15,147 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from NEW to INITING
2015-03-13 10:32:15,147 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000001 to application application_1426267835672_0006
2015-03-13 10:32:15,147 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0006_000001
2015-03-13 10:32:15,147 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from INITING to RUNNING
2015-03-13 10:32:15,147 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:32:15,148 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:32:15,148 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:15,148 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:15,148 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:32:15,148 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:32:15,148 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:15,148 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000001
2015-03-13 10:32:15,157 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426267835672_0006_01_000001.tokens. Credentials list: 
2015-03-13 10:32:15,172 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:15,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426267835672_0006_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001.tokens
2015-03-13 10:32:15,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:15,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:15,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:15,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:15,316 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52892, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-356116964_3021, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 489000
2015-03-13 10:32:15,335 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:15,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:15,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:15,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:15,357 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52873, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-356116964_3021, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 160000
2015-03-13 10:32:15,367 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061
2015-03-13 10:32:15,367 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058
2015-03-13 10:32:15,367 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063
2015-03-13 10:32:15,368 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060
2015-03-13 10:32:15,368 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057
2015-03-13 10:32:15,369 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064
2015-03-13 10:32:15,369 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056
2015-03-13 10:32:15,370 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:15,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:15,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:15,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:15,393 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065
2015-03-13 10:32:15,393 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056
2015-03-13 10:32:15,394 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060
2015-03-13 10:32:15,394 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057
2015-03-13 10:32:15,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52872, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-356116964_3021, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 170000
2015-03-13 10:32:15,405 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065
2015-03-13 10:32:15,405 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059
2015-03-13 10:32:15,406 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058
2015-03-13 10:32:15,406 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741881_1057
2015-03-13 10:32:15,406 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063
2015-03-13 10:32:15,407 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061
2015-03-13 10:32:15,407 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064
2015-03-13 10:32:15,408 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741884_1060
2015-03-13 10:32:15,408 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741880_1056
2015-03-13 10:32:15,411 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:15,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:15,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:15,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:15,434 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52872, bytes: 98932, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-356116964_3021, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 284000
2015-03-13 10:32:15,446 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:15,446 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:15,473 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:15,473 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:15,521 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:15,540 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001/default_container_executor.sh]
2015-03-13 10:32:15,594 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062
2015-03-13 10:32:15,594 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059
2015-03-13 10:32:15,595 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063
2015-03-13 10:32:15,595 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064
2015-03-13 10:32:15,633 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062
2015-03-13 10:32:15,634 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059
2015-03-13 10:32:15,808 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062
2015-03-13 10:32:15,837 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741885_1061
2015-03-13 10:32:15,838 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741882_1058
2015-03-13 10:32:15,839 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065
2015-03-13 10:32:15,839 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063
2015-03-13 10:32:15,927 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741886_1062 to datanode(s) 127.0.0.1:52454
2015-03-13 10:32:15,927 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741877_1053, blk_1073741878_1054, blk_1073741880_1056]
2015-03-13 10:32:15,928 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054, blk_1073741880_1056]
2015-03-13 10:32:16,139 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:16,140 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:16,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:16,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874 for deletion
2015-03-13 10:32:16,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875 for deletion
2015-03-13 10:32:16,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876 for deletion
2015-03-13 10:32:16,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877 for deletion
2015-03-13 10:32:16,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874
2015-03-13 10:32:16,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878 for deletion
2015-03-13 10:32:16,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880 for deletion
2015-03-13 10:32:16,605 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876
2015-03-13 10:32:16,606 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878
2015-03-13 10:32:16,606 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880
2015-03-13 10:32:16,606 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875
2015-03-13 10:32:16,606 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877
2015-03-13 10:32:16,612 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 to 127.0.0.1:52454 
2015-03-13 10:32:16,613 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874 for deletion
2015-03-13 10:32:16,613 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875 for deletion
2015-03-13 10:32:16,613 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877 for deletion
2015-03-13 10:32:16,613 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878 for deletion
2015-03-13 10:32:16,613 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880 for deletion
2015-03-13 10:32:16,614 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874
2015-03-13 10:32:16,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875
2015-03-13 10:32:16,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878
2015-03-13 10:32:16,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877
2015-03-13 10:32:16,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880
2015-03-13 10:32:16,617 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:32:16,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52893 dest: /127.0.0.1:52454
2015-03-13 10:32:16,620 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062 src: /127.0.0.1:52893 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:32:16,621 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741886_1062 size 254067
2015-03-13 10:32:17,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:17,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:32:17,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:32:17,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:32:17,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:17,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006	dst=null	perm=null
2015-03-13 10:32:17,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:32:17,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:32:17,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:17,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:17,530 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:17,534 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52895, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741888_1064, duration: 210000
2015-03-13 10:32:18,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:18,280 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:18,281 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0006_000001
2015-03-13 10:32:18,282 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0006	APPATTEMPTID=appattempt_1426267835672_0006_000001
2015-03-13 10:32:18,282 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:32:18,282 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from ACCEPTED to RUNNING
2015-03-13 10:32:18,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:18,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:18,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:18,497 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:18,535 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:18,536 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066 src: /127.0.0.1:52901 dest: /127.0.0.1:52444
2015-03-13 10:32:18,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066 src: /127.0.0.1:52902 dest: /127.0.0.1:52454
2015-03-13 10:32:18,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066 src: /127.0.0.1:52903 dest: /127.0.0.1:52451
2015-03-13 10:32:18,548 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52903, dest: /127.0.0.1:52451, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, duration: 6658000
2015-03-13 10:32:18,549 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:18,549 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52902, dest: /127.0.0.1:52454, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, duration: 7453000
2015-03-13 10:32:18,550 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:18,549 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:18,551 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52901, dest: /127.0.0.1:52444, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, duration: 9292000
2015-03-13 10:32:18,551 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:18,551 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:18,552 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:18,556 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:18,933 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741880_1056]
2015-03-13 10:32:18,933 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741874_1050, blk_1073741875_1051, blk_1073741876_1052, blk_1073741877_1053, blk_1073741878_1054]
2015-03-13 10:32:19,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:19,364 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:19,364 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:19,365 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:19,365 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0006_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,365 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:32:19,365 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,366 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:19,366 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:19,366 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:32:19,367 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0006_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,367 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:32:19,367 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,367 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:19,367 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:19,368 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:32:19,368 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0006_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,368 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:32:19,368 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,368 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:19,368 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:19,369 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:32:19,369 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0006_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,369 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:32:19,369 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:19,538 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:19,639 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0005_01_000001 succeeded 
2015-03-13 10:32:19,640 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:32:19,640 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0005/container_1426267835672_0005_01_000001
2015-03-13 10:32:19,647 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000001
2015-03-13 10:32:19,648 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0005_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:32:19,648 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0005_01_000001 from application application_1426267835672_0005
2015-03-13 10:32:19,648 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:19,648 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0005
2015-03-13 10:32:19,816 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874 for deletion
2015-03-13 10:32:19,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875 for deletion
2015-03-13 10:32:19,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876 for deletion
2015-03-13 10:32:19,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877 for deletion
2015-03-13 10:32:19,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875
2015-03-13 10:32:19,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874
2015-03-13 10:32:19,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878 for deletion
2015-03-13 10:32:19,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741877_1053 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741877
2015-03-13 10:32:19,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876
2015-03-13 10:32:19,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741878_1054 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741878
2015-03-13 10:32:19,975 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874 for deletion
2015-03-13 10:32:19,975 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875 for deletion
2015-03-13 10:32:19,976 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876 for deletion
2015-03-13 10:32:19,976 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741874_1050 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741874
2015-03-13 10:32:19,976 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880 for deletion
2015-03-13 10:32:19,976 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741876_1052 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741876
2015-03-13 10:32:19,976 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741875
2015-03-13 10:32:19,977 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741880_1056 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741880
2015-03-13 10:32:20,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:20,315 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:20,315 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:20,315 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:20,316 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:20,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:20,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:20,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:20,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:20,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:20,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:20,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:20,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:20,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:20,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:20,380 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062
2015-03-13 10:32:20,440 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:20,442 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000002 by user soberoi
2015-03-13 10:32:20,442 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000004 by user soberoi
2015-03-13 10:32:20,442 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0006
2015-03-13 10:32:20,443 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000003 by user soberoi
2015-03-13 10:32:20,443 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000004 to application application_1426267835672_0006
2015-03-13 10:32:20,443 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:20,443 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:20,443 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from NEW to INITING
2015-03-13 10:32:20,443 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000002 to application application_1426267835672_0006
2015-03-13 10:32:20,443 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000005 by user soberoi
2015-03-13 10:32:20,444 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:20,443 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:20,443 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000003 to application application_1426267835672_0006
2015-03-13 10:32:20,444 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000005 to application application_1426267835672_0006
2015-03-13 10:32:20,444 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from INITING to RUNNING
2015-03-13 10:32:20,445 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:32:20,445 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:32:20,445 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:32:20,445 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:32:20,445 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,446 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,446 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:20,446 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:20,446 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:20,446 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:20,446 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,446 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,446 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:20,446 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:20,447 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,447 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,447 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:20,447 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:20,447 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,447 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:20,447 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:20,447 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:20,448 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000004
2015-03-13 10:32:20,448 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000005
2015-03-13 10:32:20,449 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000003
2015-03-13 10:32:20,449 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000002
2015-03-13 10:32:20,468 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0006_01_000002.tokens. Credentials list: 
2015-03-13 10:32:20,469 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0006_01_000005.tokens. Credentials list: 
2015-03-13 10:32:20,469 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426267835672_0006_01_000004.tokens. Credentials list: 
2015-03-13 10:32:20,469 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0006_01_000003.tokens. Credentials list: 
2015-03-13 10:32:20,484 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:20,539 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:32:20,539 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0005_01_000001
2015-03-13 10:32:20,540 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0005_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:20,540 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0005_000001
2015-03-13 10:32:20,540 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0005_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:32:20,540 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0005_000001 State change from FINISHING to FINISHED
2015-03-13 10:32:20,540 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0005	CONTAINERID=container_1426267835672_0005_01_000001
2015-03-13 10:32:20,540 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0005 State change from FINISHING to FINISHED
2015-03-13 10:32:20,540 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:20,541 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0005
2015-03-13 10:32:20,541 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0005_000001
2015-03-13 10:32:20,541 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0005,name=[AA7C1D7EA74C4401BE2D2CFBE5BCEEF1/5E7BEE4954DF42539615E4FD31314DC4] trap test/(1/1) ...tform/trapsourcesink/sink,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0005/jobhistory/job/job_1426267835672_0005,appMasterHost=Edinburgh.local,startTime=1426267919207,finishTime=1426267933494,finalStatus=SUCCEEDED
2015-03-13 10:32:20,541 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:32:20,541 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0005_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:20,541 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:20,541 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:32:20,541 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0005_000001 released container container_1426267835672_0005_01_000001 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:20,541 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0005_000001 is done. finalState=FINISHED
2015-03-13 10:32:20,542 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0005 requests cleared
2015-03-13 10:32:20,542 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0005 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:32:20,542 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0005 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:32:20,543 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0005_000001 (auth:SIMPLE)
2015-03-13 10:32:20,545 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0005_01_000001
2015-03-13 10:32:20,555 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0006_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002.tokens
2015-03-13 10:32:20,555 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:20,579 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066
2015-03-13 10:32:20,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:20,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:20,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:20,624 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52908, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-310803793_3133, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 506000
2015-03-13 10:32:20,642 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:20,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:20,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:20,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:20,664 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52908, bytes: 98932, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-310803793_3133, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 239000
2015-03-13 10:32:20,677 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:20,677 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:20,677 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:20,677 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:20,678 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:20,725 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:20,725 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:20,725 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:20,725 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:20,726 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:20,726 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:20,739 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:20,739 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:20,815 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066
2015-03-13 10:32:20,830 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005/default_container_executor.sh]
2015-03-13 10:32:20,830 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002/default_container_executor.sh]
2015-03-13 10:32:20,831 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003/default_container_executor.sh]
2015-03-13 10:32:20,843 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066
2015-03-13 10:32:20,865 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004/default_container_executor.sh]
2015-03-13 10:32:21,158 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,328 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:32:21,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,372 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,372 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,372 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:21,372 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:21,373 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:21,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,373 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:21,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,373 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0005
2015-03-13 10:32:21,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,373 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:21,373 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0005, with delay of 10800 seconds
2015-03-13 10:32:21,374 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,373 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:21,374 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:21,541 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:21,541 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,541 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,542 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0005
2015-03-13 10:32:21,542 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:21,542 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0005, with delay of 10800 seconds
2015-03-13 10:32:21,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0005
2015-03-13 10:32:21,709 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:21,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0006_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003.tokens
2015-03-13 10:32:21,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:21,929 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:22,074 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426267835672_0006_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004.tokens
2015-03-13 10:32:22,075 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:22,159 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:22,178 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:22,311 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0006_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005.tokens
2015-03-13 10:32:22,311 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:22,373 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:22,373 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:22,373 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:22,374 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,160 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,376 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,376 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,376 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:23,377 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,379 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:24,379 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,168 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,380 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:25,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,173 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:26,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:27,174 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:27,220 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52917, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000003_0_2129760938_1, offset: 1024, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 184000
2015-03-13 10:32:27,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:27,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.split	dst=null	perm=null
2015-03-13 10:32:27,379 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52919, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000000_0_-1479098652_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 174000
2015-03-13 10:32:27,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:27,388 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52922, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000003_0_2129760938_1, offset: 512, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 184000
2015-03-13 10:32:27,388 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:27,496 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52925, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000000_0_-1479098652_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 164000
2015-03-13 10:32:27,500 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52923, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000002_0_126898450_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 179000
2015-03-13 10:32:27,503 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52924, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000001_0_-409086295_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741887_1063, duration: 167000
2015-03-13 10:32:27,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:27,593 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52926, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000002_0_126898450_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1061000
2015-03-13 10:32:27,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:27,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_m_000003_0	dst=null	perm=null
2015-03-13 10:32:27,776 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000005
2015-03-13 10:32:27,776 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:27,776 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:32:27,776 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000005
2015-03-13 10:32:27,776 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,777 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,777 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,777 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:27,789 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000005 is : 143
2015-03-13 10:32:27,792 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:27,793 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067 src: /127.0.0.1:52927 dest: /127.0.0.1:52444
2015-03-13 10:32:27,795 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067 src: /127.0.0.1:52928 dest: /127.0.0.1:52447
2015-03-13 10:32:27,797 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067 src: /127.0.0.1:52929 dest: /127.0.0.1:52454
2015-03-13 10:32:27,803 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist for DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:27,805 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:27,806 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005
2015-03-13 10:32:27,806 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005
2015-03-13 10:32:27,806 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005
2015-03-13 10:32:27,806 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:27,806 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:27,807 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000005 from application application_1426267835672_0006
2015-03-13 10:32:27,807 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:27,807 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:27,807 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000005
2015-03-13 10:32:27,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_m_000000_0	dst=null	perm=null
2015-03-13 10:32:27,913 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000002
2015-03-13 10:32:27,914 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:27,914 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:32:27,914 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000002
2015-03-13 10:32:27,914 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:27,915 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,915 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:27,915 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:27,915 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000005
2015-03-13 10:32:27,916 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:27,916 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:32:27,916 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000005
2015-03-13 10:32:27,916 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:32:27,916 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:32:27,916 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:27,917 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:27,917 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:32:27,917 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000005 on node: host: 10.1.1.144:52481 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:32:27,927 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000002 is : 143
2015-03-13 10:32:27,940 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:27,940 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002
2015-03-13 10:32:27,940 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002
2015-03-13 10:32:27,941 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002
2015-03-13 10:32:27,941 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:27,941 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:27,941 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000002 from application application_1426267835672_0006
2015-03-13 10:32:27,941 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000002
2015-03-13 10:32:27,941 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:27,942 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:27,978 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52930, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0006_m_000001_0_-409086295_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1336000
2015-03-13 10:32:28,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_m_000001_0	dst=null	perm=null
2015-03-13 10:32:28,020 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000003
2015-03-13 10:32:28,020 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:28,021 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:32:28,021 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000003
2015-03-13 10:32:28,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:28,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000002
2015-03-13 10:32:28,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:28,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:28,022 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:28,022 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:32:28,022 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000002
2015-03-13 10:32:28,022 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:32:28,023 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:32:28,023 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:28,023 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:28,023 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:32:28,023 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000002 on node: host: 10.1.1.144:52481 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:32:28,034 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000003 is : 143
2015-03-13 10:32:28,046 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:28,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003
2015-03-13 10:32:28,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003
2015-03-13 10:32:28,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003
2015-03-13 10:32:28,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000003
2015-03-13 10:32:28,047 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:28,048 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:28,048 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000003 from application application_1426267835672_0006
2015-03-13 10:32:28,048 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:28,048 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:28,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_m_000002_0	dst=null	perm=null
2015-03-13 10:32:28,069 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000004
2015-03-13 10:32:28,069 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:28,069 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:32:28,070 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000004
2015-03-13 10:32:28,070 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:28,070 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000003
2015-03-13 10:32:28,070 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:28,071 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:28,071 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:32:28,071 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000003
2015-03-13 10:32:28,071 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:32:28,071 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:32:28,071 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:28,072 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:28,072 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:32:28,072 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000003 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:32:28,081 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000004 is : 143
2015-03-13 10:32:28,089 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:28,090 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000004
2015-03-13 10:32:28,090 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:28,090 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000004 from application application_1426267835672_0006
2015-03-13 10:32:28,091 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:28,091 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:28,176 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:29,071 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:29,071 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000004
2015-03-13 10:32:29,072 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:29,072 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:32:29,072 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000004
2015-03-13 10:32:29,073 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:29,073 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:29,073 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:29,073 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:29,073 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:29,073 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000004 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:29,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:29,553 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:29,553 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:29,554 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:29,554 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0006 container=Container: [ContainerId: container_1426267835672_0006_01_000006, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0006_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:29,554 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:32:29,554 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:30,184 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:30,365 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:30,376 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:30,378 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0006_01_000006 by user soberoi
2015-03-13 10:32:30,378 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0006
2015-03-13 10:32:30,379 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:30,379 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from NEW to INITING
2015-03-13 10:32:30,379 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0006_01_000006 to application application_1426267835672_0006
2015-03-13 10:32:30,380 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from INITING to RUNNING
2015-03-13 10:32:30,380 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:32:30,380 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0006
2015-03-13 10:32:30,381 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0006
2015-03-13 10:32:30,381 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:30,381 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0006
2015-03-13 10:32:30,381 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:30,381 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:30,381 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0006_01_000006
2015-03-13 10:32:30,390 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426267835672_0006_01_000006.tokens. Credentials list: 
2015-03-13 10:32:30,406 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:30,476 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426267835672_0006_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006.tokens
2015-03-13 10:32:30,476 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:30,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:30,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:30,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar	dst=null	perm=null
2015-03-13 10:32:30,545 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52934, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_899693614_3400, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741886_1062, duration: 507000
2015-03-13 10:32:30,553 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:30,553 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:30,566 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:30,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:30,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:30,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml	dst=null	perm=null
2015-03-13 10:32:30,589 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52935, bytes: 98932, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_899693614_3400, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741889_1065, duration: 301000
2015-03-13 10:32:30,602 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:30,603 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:30,632 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:30,633 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:30,699 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006/default_container_executor.sh]
2015-03-13 10:32:31,189 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:31,374 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:32:31,554 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:32,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:32,559 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:33,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary	dst=null	perm=null
2015-03-13 10:32:33,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:33,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,151 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:33,197 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:33,206 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068 src: /127.0.0.1:52940 dest: /127.0.0.1:52444
2015-03-13 10:32:33,207 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068 src: /127.0.0.1:52941 dest: /127.0.0.1:52454
2015-03-13 10:32:33,208 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068 src: /127.0.0.1:52942 dest: /127.0.0.1:52451
2015-03-13 10:32:33,219 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52942, dest: /127.0.0.1:52451, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 9749000
2015-03-13 10:32:33,219 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,220 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52941, dest: /127.0.0.1:52454, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 10342000
2015-03-13 10:32:33,220 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,221 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,220 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52940, dest: /127.0.0.1:52444, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 11365000
2015-03-13 10:32:33,221 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,221 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,224 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1
2015-03-13 10:32:33,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:32:33,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:32:33,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:32:33,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:32:33,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:32:33,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:33,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:32:33,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0/part-r-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/part-r-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary/_attempt_1426267835672_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:32:33,251 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0006_r_000000_0_504474264_1
2015-03-13 10:32:33,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:32:33,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:32:33,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/task_1426267835672_0006_r_000000	dst=null	perm=null
2015-03-13 10:32:33,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/_temporary/attempt_1426267835672_0006_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/task_1426267835672_0006_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:33,269 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000006
2015-03-13 10:32:33,270 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:33,270 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:32:33,270 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000006
2015-03-13 10:32:33,270 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:33,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,278 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,280 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0006_01_000006 is : 143
2015-03-13 10:32:33,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1	dst=null	perm=null
2015-03-13 10:32:33,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:33,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:33,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/task_1426267835672_0006_r_000000	dst=null	perm=null
2015-03-13 10:32:33,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000	dst=null	perm=null
2015-03-13 10:32:33,290 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:33,291 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000006
2015-03-13 10:32:33,291 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:33,292 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000006 from application application_1426267835672_0006
2015-03-13 10:32:33,292 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:33,292 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:33,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary/1/task_1426267835672_0006_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary	dst=null	perm=null
2015-03-13 10:32:33,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,302 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,306 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,320 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52929, dest: /127.0.0.1:52454, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, duration: 5521416000
2015-03-13 10:32:33,320 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,321 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,321 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52928, dest: /127.0.0.1:52447, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, duration: 5521649000
2015-03-13 10:32:33,322 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,323 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,323 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52927, dest: /127.0.0.1:52444, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, duration: 5524702000
2015-03-13 10:32:33,323 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,324 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,325 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,328 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:33,330 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069 src: /127.0.0.1:52943 dest: /127.0.0.1:52451
2015-03-13 10:32:33,332 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069 src: /127.0.0.1:52944 dest: /127.0.0.1:52444
2015-03-13 10:32:33,333 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069 src: /127.0.0.1:52945 dest: /127.0.0.1:52447
2015-03-13 10:32:33,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52945, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, duration: 1195000
2015-03-13 10:32:33,336 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,336 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:33,336 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52944, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, duration: 1795000
2015-03-13 10:32:33,337 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,337 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:33,337 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52943, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, duration: 2845000
2015-03-13 10:32:33,338 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,338 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:33,339 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist	dst=null	perm=null
2015-03-13 10:32:33,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:32:33,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist	dst=null	perm=null
2015-03-13 10:32:33,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:32:33,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1.jhist	dst=null	perm=null
2015-03-13 10:32:33,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52946, bytes: 60209, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067, duration: 240000
2015-03-13 10:32:33,357 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:33,359 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070 src: /127.0.0.1:52947 dest: /127.0.0.1:52451
2015-03-13 10:32:33,360 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070 src: /127.0.0.1:52948 dest: /127.0.0.1:52444
2015-03-13 10:32:33,362 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070 src: /127.0.0.1:52949 dest: /127.0.0.1:52454
2015-03-13 10:32:33,365 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52949, dest: /127.0.0.1:52454, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, duration: 1893000
2015-03-13 10:32:33,365 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,366 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,366 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52948, dest: /127.0.0.1:52444, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, duration: 2697000
2015-03-13 10:32:33,366 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,367 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,367 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52947, dest: /127.0.0.1:52451, bytes: 59741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, duration: 3548000
2015-03-13 10:32:33,367 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,368 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:33,369 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:33,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:32:33,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:33,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:32:33,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006/job_1426267835672_0006_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:33,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:33,382 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52946, bytes: 91464, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741890_1066, duration: 331000
2015-03-13 10:32:33,384 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:33,385 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071 src: /127.0.0.1:52950 dest: /127.0.0.1:52444
2015-03-13 10:32:33,387 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071 src: /127.0.0.1:52951 dest: /127.0.0.1:52454
2015-03-13 10:32:33,388 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071 src: /127.0.0.1:52952 dest: /127.0.0.1:52451
2015-03-13 10:32:33,391 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52952, dest: /127.0.0.1:52451, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, duration: 1987000
2015-03-13 10:32:33,391 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:33,392 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,392 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52951, dest: /127.0.0.1:52454, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, duration: 2561000
2015-03-13 10:32:33,392 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,393 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,393 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52950, dest: /127.0.0.1:52444, bytes: 90752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-117058251_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, duration: 3448000
2015-03-13 10:32:33,393 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:33,394 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:33,395 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-117058251_1
2015-03-13 10:32:33,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:33,406 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from RUNNING to FINISHING
2015-03-13 10:32:33,407 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0006
2015-03-13 10:32:33,407 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from RUNNING to REMOVING
2015-03-13 10:32:33,407 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0006
2015-03-13 10:32:33,407 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from REMOVING to FINISHING
2015-03-13 10:32:34,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:34,271 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:34,271 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000006
2015-03-13 10:32:34,272 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:34,272 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:32:34,272 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000006
2015-03-13 10:32:34,273 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:34,273 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:34,273 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000006, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:34,273 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:34,273 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:34,273 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000006 on node: host: 10.1.1.144:52469 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:34,416 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741886_1062 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:32:34,416 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741887_1063 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52454 
2015-03-13 10:32:34,416 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741888_1064 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:32:34,417 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741889_1065 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52451 
2015-03-13 10:32:34,417 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741891_1067 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:32:34,417 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741890_1066 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 
2015-03-13 10:32:34,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0006	dst=null	perm=null
2015-03-13 10:32:34,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:34,446 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary
2015-03-13 10:32:34,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/_temporary	dst=null	perm=null
2015-03-13 10:32:34,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:34,447 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary
2015-03-13 10:32:34,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary	dst=null	perm=null
2015-03-13 10:32:34,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/_temporary	dst=null	perm=null
2015-03-13 10:32:34,456 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:34,457 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:34,457 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:34,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:34,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:34,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:34,460 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:34,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000	dst=null	perm=null
2015-03-13 10:32:34,468 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:34,468 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:34,469 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:34,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:34,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:34,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:34,472 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:34,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:32:34,475 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52954, bytes: 132, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 194000
2015-03-13 10:32:34,475 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everycomplete/trap
2015-03-13 10:32:34,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:34,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:34,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:34,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap	dst=null	perm=null
2015-03-13 10:32:34,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:32:34,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:32:34,482 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52955, bytes: 132, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068, duration: 174000
2015-03-13 10:32:34,482 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everycomplete/tap
2015-03-13 10:32:34,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:34,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:34,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:34,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap	dst=null	perm=null
2015-03-13 10:32:34,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000	dst=null	perm=null
2015-03-13 10:32:34,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everycomplete/tap/part-00000	dst=null	perm=null
2015-03-13 10:32:34,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:34,499 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:34,500 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:32:34,500 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:32:34,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:34,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:34,515 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:32:34,515 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:32:34,515 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic"]
2015-03-13 10:32:34,516 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:32:34,516 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:32:34,516 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:32:34,516 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...hain/tap-nondeterministic
2015-03-13 10:32:34,525 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:34,534 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:34,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:34,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:34,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:34,539 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 7
2015-03-13 10:32:34,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007	dst=null	perm=null
2015-03-13 10:32:34,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:32:34,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:32:34,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:34,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,546 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:34,547 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52957 dest: /127.0.0.1:52444
2015-03-13 10:32:34,548 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52958 dest: /127.0.0.1:52451
2015-03-13 10:32:34,549 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52959 dest: /127.0.0.1:52454
2015-03-13 10:32:34,553 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52959, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 1971000
2015-03-13 10:32:34,553 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:34,554 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:34,554 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52958, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 2539000
2015-03-13 10:32:34,554 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,554 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:34,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52957, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 3732000
2015-03-13 10:32:34,555 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,556 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:34,557 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:34,558 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar
2015-03-13 10:32:34,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:34,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:34,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:34,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:34,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:32:34,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:32:34,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:32:34,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:32:34,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:32:34,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:34,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:34,570 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:34,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:34,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,575 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split
2015-03-13 10:32:34,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:34,576 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:34,578 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073 src: /127.0.0.1:52960 dest: /127.0.0.1:52444
2015-03-13 10:32:34,579 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073 src: /127.0.0.1:52961 dest: /127.0.0.1:52454
2015-03-13 10:32:34,581 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073 src: /127.0.0.1:52962 dest: /127.0.0.1:52451
2015-03-13 10:32:34,582 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073 src: /127.0.0.1:52963 dest: /127.0.0.1:52447
2015-03-13 10:32:34,585 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52963, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 1525000
2015-03-13 10:32:34,585 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:34,585 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:34,585 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52962, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 1895000
2015-03-13 10:32:34,586 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,586 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:34,586 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52961, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 2656000
2015-03-13 10:32:34,586 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,587 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:34,587 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52960, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 3408000
2015-03-13 10:32:34,587 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,589 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:34,590 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:34,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,593 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:34,595 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074 src: /127.0.0.1:52964 dest: /127.0.0.1:52447
2015-03-13 10:32:34,596 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074 src: /127.0.0.1:52965 dest: /127.0.0.1:52444
2015-03-13 10:32:34,597 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074 src: /127.0.0.1:52966 dest: /127.0.0.1:52451
2015-03-13 10:32:34,599 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52966, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 1150000
2015-03-13 10:32:34,599 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:34,599 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,600 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52965, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 1547000
2015-03-13 10:32:34,600 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,600 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,600 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52964, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 2298000
2015-03-13 10:32:34,601 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,603 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,604 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:34,604 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:32:34,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:34,608 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:34,608 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:34,609 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:34,615 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:34,616 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075 src: /127.0.0.1:52967 dest: /127.0.0.1:52454
2015-03-13 10:32:34,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075 src: /127.0.0.1:52968 dest: /127.0.0.1:52447
2015-03-13 10:32:34,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075 src: /127.0.0.1:52969 dest: /127.0.0.1:52451
2015-03-13 10:32:34,622 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52969, dest: /127.0.0.1:52451, bytes: 97209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 1455000
2015-03-13 10:32:34,622 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:34,623 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52968, dest: /127.0.0.1:52447, bytes: 97209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 2104000
2015-03-13 10:32:34,623 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,624 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52967, dest: /127.0.0.1:52454, bytes: 97209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 3006000
2015-03-13 10:32:34,624 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:34,625 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:34,626 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:34,627 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0007
2015-03-13 10:32:34,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007	dst=null	perm=null
2015-03-13 10:32:34,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:34,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:34,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:34,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:34,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:34,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:34,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:34,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:34,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:34,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:34,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:34,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:34,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:34,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:34,642 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 7 submitted by user soberoi
2015-03-13 10:32:34,642 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0007
2015-03-13 10:32:34,642 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0007
2015-03-13 10:32:34,642 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0007
2015-03-13 10:32:34,642 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from NEW to NEW_SAVING
2015-03-13 10:32:34,642 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:32:34,643 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0007_000001
2015-03-13 10:32:34,643 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from NEW to SUBMITTED
2015-03-13 10:32:34,643 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0007 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:34,643 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0007 from user: soberoi activated in queue: default
2015-03-13 10:32:34,643 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0007 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:32:34,643 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0007 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:32:34,643 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0007_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:32:34,644 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:32:34,644 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from SUBMITTED to ACCEPTED
2015-03-13 10:32:34,645 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0007/
2015-03-13 10:32:34,645 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0007
2015-03-13 10:32:34,645 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0007/
2015-03-13 10:32:35,089 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:35,089 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000001
2015-03-13 10:32:35,089 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:32:35,090 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0007_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:35,090 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:32:35,090 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:35,090 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:35,091 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0007 AttemptId: appattempt_1426267835672_0007_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:32:35,091 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:32:35,091 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0007_000001
2015-03-13 10:32:35,092 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:32:35,092 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0007_000001
2015-03-13 10:32:35,092 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0007_000001
2015-03-13 10:32:35,093 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0007_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:32:35,095 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0007_000001 (auth:SIMPLE)
2015-03-13 10:32:35,097 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000001 by user soberoi
2015-03-13 10:32:35,097 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0007
2015-03-13 10:32:35,097 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000001
2015-03-13 10:32:35,097 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from NEW to INITING
2015-03-13 10:32:35,097 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000001 to application application_1426267835672_0007
2015-03-13 10:32:35,098 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from INITING to RUNNING
2015-03-13 10:32:35,098 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0007_000001
2015-03-13 10:32:35,098 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:32:35,098 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:35,098 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:32:35,098 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:35,099 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:32:35,099 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:32:35,099 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:35,099 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000001
2015-03-13 10:32:35,108 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0007_01_000001.tokens. Credentials list: 
2015-03-13 10:32:35,123 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:35,193 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0007_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001.tokens
2015-03-13 10:32:35,193 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:35,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:35,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:35,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:35,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:35,262 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52955, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-391906672_3548, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 508000
2015-03-13 10:32:35,281 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:35,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:35,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:35,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:35,304 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:52973, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-391906672_3548, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 174000
2015-03-13 10:32:35,316 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:35,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:35,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:35,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:35,339 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:52954, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-391906672_3548, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 173000
2015-03-13 10:32:35,351 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:35,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:35,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:35,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:35,374 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52955, bytes: 97969, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-391906672_3548, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 269000
2015-03-13 10:32:35,386 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:35,386 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:35,411 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:35,411 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:35,477 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001/default_container_executor.sh]
2015-03-13 10:32:35,584 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071
2015-03-13 10:32:35,585 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068
2015-03-13 10:32:35,585 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070
2015-03-13 10:32:35,586 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067
2015-03-13 10:32:35,605 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073
2015-03-13 10:32:35,606 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067
2015-03-13 10:32:35,606 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074
2015-03-13 10:32:35,606 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069
2015-03-13 10:32:35,607 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075
2015-03-13 10:32:35,791 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072
2015-03-13 10:32:35,792 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075
2015-03-13 10:32:35,792 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073
2015-03-13 10:32:35,826 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070
2015-03-13 10:32:35,826 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073
2015-03-13 10:32:35,852 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071
2015-03-13 10:32:35,853 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075
2015-03-13 10:32:36,032 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072
2015-03-13 10:32:36,032 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069
2015-03-13 10:32:36,033 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068
2015-03-13 10:32:36,033 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074
2015-03-13 10:32:36,034 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741891_1067
2015-03-13 10:32:36,034 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741895_1071
2015-03-13 10:32:36,054 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072
2015-03-13 10:32:36,054 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069
2015-03-13 10:32:36,054 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074
2015-03-13 10:32:36,055 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741894_1070
2015-03-13 10:32:36,055 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073
2015-03-13 10:32:36,055 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741892_1068
2015-03-13 10:32:36,091 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:36,092 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:36,205 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:36,953 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52454 to replicate blk_1073741896_1072 to datanode(s) 127.0.0.1:52447
2015-03-13 10:32:36,953 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741891_1067, blk_1073741886_1062, blk_1073741887_1063]
2015-03-13 10:32:36,953 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741891_1067, blk_1073741886_1062, blk_1073741887_1063]
2015-03-13 10:32:37,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:37,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:37,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:32:37,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:32:37,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:32:37,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007	dst=null	perm=null
2015-03-13 10:32:37,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:32:37,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:32:37,209 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:37,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:37,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:37,482 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52975, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741898_1074, duration: 192000
2015-03-13 10:32:37,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888 for deletion
2015-03-13 10:32:37,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889 for deletion
2015-03-13 10:32:37,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891 for deletion
2015-03-13 10:32:37,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886 for deletion
2015-03-13 10:32:37,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887 for deletion
2015-03-13 10:32:37,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889
2015-03-13 10:32:37,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888
2015-03-13 10:32:37,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887
2015-03-13 10:32:37,619 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891
2015-03-13 10:32:37,620 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886
2015-03-13 10:32:37,987 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 to 127.0.0.1:52447 
2015-03-13 10:32:37,987 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888 for deletion
2015-03-13 10:32:37,987 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890 for deletion
2015-03-13 10:32:37,987 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891 for deletion
2015-03-13 10:32:37,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886 for deletion
2015-03-13 10:32:37,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887 for deletion
2015-03-13 10:32:37,989 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 (numBytes=254067) to /127.0.0.1:52447
2015-03-13 10:32:37,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891
2015-03-13 10:32:37,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886
2015-03-13 10:32:37,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888
2015-03-13 10:32:37,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887
2015-03-13 10:32:37,990 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890
2015-03-13 10:32:37,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52978 dest: /127.0.0.1:52447
2015-03-13 10:32:37,991 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072 src: /127.0.0.1:52978 dest: /127.0.0.1:52447 of size 254067
2015-03-13 10:32:37,992 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741896_1072 size 254067
2015-03-13 10:32:38,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:38,211 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:38,235 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0007_000001 (auth:SIMPLE)
2015-03-13 10:32:38,236 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0007_000001
2015-03-13 10:32:38,237 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0007	APPATTEMPTID=appattempt_1426267835672_0007_000001
2015-03-13 10:32:38,237 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:32:38,237 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from ACCEPTED to RUNNING
2015-03-13 10:32:38,257 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 656 Total time for transactions(ms): 51 Number of transactions batched in Syncs: 11 Number of syncs: 363 SyncTimes(ms): 91 58 
2015-03-13 10:32:38,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:38,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:38,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:38,465 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:38,504 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076 src: /127.0.0.1:52982 dest: /127.0.0.1:52451
2015-03-13 10:32:38,506 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076 src: /127.0.0.1:52983 dest: /127.0.0.1:52447
2015-03-13 10:32:38,509 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076 src: /127.0.0.1:52984 dest: /127.0.0.1:52454
2015-03-13 10:32:38,517 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52984, dest: /127.0.0.1:52454, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, duration: 6383000
2015-03-13 10:32:38,518 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:38,518 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:38,518 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52983, dest: /127.0.0.1:52447, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, duration: 7096000
2015-03-13 10:32:38,519 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:38,519 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:38,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:52982, dest: /127.0.0.1:52451, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, duration: 7933000
2015-03-13 10:32:38,519 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:38,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:38,524 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:39,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:39,211 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:39,276 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:39,277 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:39,277 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:39,277 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000002, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0007_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,277 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:32:39,278 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,278 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:39,279 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:39,279 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:32:39,279 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000003, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0007_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,279 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:32:39,279 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,280 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:39,280 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:39,280 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:32:39,280 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000004, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0007_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,280 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:32:39,280 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,281 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:39,281 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:39,281 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:32:39,281 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0007 container=Container: [ContainerId: container_1426267835672_0007_01_000005, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] containerId=container_1426267835672_0007_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,281 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:32:39,281 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:39,551 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0006_01_000001 succeeded 
2015-03-13 10:32:39,552 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:32:39,552 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0006_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:32:39,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001
2015-03-13 10:32:39,561 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0006_01_000001 from application application_1426267835672_0006
2015-03-13 10:32:39,562 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:39,562 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0006
2015-03-13 10:32:39,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0006/container_1426267835672_0006_01_000001
2015-03-13 10:32:39,959 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741888_1064, blk_1073741889_1065, blk_1073741890_1066, blk_1073741891_1067, blk_1073741886_1062, blk_1073741887_1063]
2015-03-13 10:32:39,959 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741889_1065, blk_1073741890_1066, blk_1073741886_1062, blk_1073741887_1063]
2015-03-13 10:32:40,104 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:40,212 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:32:40,213 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0006_01_000001
2015-03-13 10:32:40,213 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0006_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:40,213 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0006_000001
2015-03-13 10:32:40,213 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0006_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:32:40,214 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0006_000001 State change from FINISHING to FINISHED
2015-03-13 10:32:40,214 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0006	CONTAINERID=container_1426267835672_0006_01_000001
2015-03-13 10:32:40,214 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0006 State change from FINISHING to FINISHED
2015-03-13 10:32:40,214 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0006_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:40,214 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0006
2015-03-13 10:32:40,214 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:32:40,215 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0006,name=[2E6720DC81AE485EA9AF60ED96CF5170/FD9C0A1F88154A1F92C3C9299F12FC78] trap test/(1/1) ...latform/everycomplete/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0006/jobhistory/job/job_1426267835672_0006,appMasterHost=Edinburgh.local,startTime=1426267934765,finishTime=1426267953407,finalStatus=SUCCEEDED
2015-03-13 10:32:40,214 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0006_000001
2015-03-13 10:32:40,215 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0006_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:40,215 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:40,215 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:32:40,215 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0006_000001 released container container_1426267835672_0006_01_000001 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:40,216 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0006_000001 is done. finalState=FINISHED
2015-03-13 10:32:40,216 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0006 requests cleared
2015-03-13 10:32:40,216 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0006 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:32:40,216 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0006 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:32:40,218 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0006_000001 (auth:SIMPLE)
2015-03-13 10:32:40,220 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0006_01_000001
2015-03-13 10:32:40,270 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:40,270 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:40,271 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:40,271 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:40,278 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:40,279 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:40,279 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0006
2015-03-13 10:32:40,279 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:40,279 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0006, with delay of 10800 seconds
2015-03-13 10:32:40,280 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:40,280 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:40,280 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:40,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:40,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:40,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:40,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:40,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:40,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:40,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:40,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:40,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:40,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:40,392 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0007_000001 (auth:SIMPLE)
2015-03-13 10:32:40,395 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000005 by user soberoi
2015-03-13 10:32:40,395 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000002 by user soberoi
2015-03-13 10:32:40,395 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0007
2015-03-13 10:32:40,396 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:40,395 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000004 by user soberoi
2015-03-13 10:32:40,395 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0007_01_000003 by user soberoi
2015-03-13 10:32:40,396 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:40,396 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000002 to application application_1426267835672_0007
2015-03-13 10:32:40,396 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:40,396 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from NEW to INITING
2015-03-13 10:32:40,397 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000005 to application application_1426267835672_0007
2015-03-13 10:32:40,396 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:40,397 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000004 to application application_1426267835672_0007
2015-03-13 10:32:40,397 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0007_01_000003 to application application_1426267835672_0007
2015-03-13 10:32:40,397 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from INITING to RUNNING
2015-03-13 10:32:40,397 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:32:40,398 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:32:40,398 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:32:40,398 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:32:40,398 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,398 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,398 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:40,398 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0007
2015-03-13 10:32:40,399 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:40,399 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:40,399 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,399 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,399 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:40,399 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0007
2015-03-13 10:32:40,400 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,400 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,400 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:40,400 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0007
2015-03-13 10:32:40,400 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,400 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0007
2015-03-13 10:32:40,400 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:40,400 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0007
2015-03-13 10:32:40,401 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000003
2015-03-13 10:32:40,402 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000004
2015-03-13 10:32:40,402 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000005
2015-03-13 10:32:40,403 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0007_01_000002
2015-03-13 10:32:40,421 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426267835672_0007_01_000004.tokens. Credentials list: 
2015-03-13 10:32:40,421 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426267835672_0007_01_000002.tokens. Credentials list: 
2015-03-13 10:32:40,421 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426267835672_0007_01_000003.tokens. Credentials list: 
2015-03-13 10:32:40,421 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426267835672_0007_01_000005.tokens. Credentials list: 
2015-03-13 10:32:40,436 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:40,504 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426267835672_0007_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004.tokens
2015-03-13 10:32:40,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:40,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:40,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:40,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar	dst=null	perm=null
2015-03-13 10:32:40,577 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:52990, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_252700680_3661, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072, duration: 604000
2015-03-13 10:32:40,598 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:40,612 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741896_1072
2015-03-13 10:32:40,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:40,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:40,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml	dst=null	perm=null
2015-03-13 10:32:40,620 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888 for deletion
2015-03-13 10:32:40,620 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889 for deletion
2015-03-13 10:32:40,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890 for deletion
2015-03-13 10:32:40,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891 for deletion
2015-03-13 10:32:40,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741888
2015-03-13 10:32:40,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890
2015-03-13 10:32:40,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886 for deletion
2015-03-13 10:32:40,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887 for deletion
2015-03-13 10:32:40,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889
2015-03-13 10:32:40,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741891
2015-03-13 10:32:40,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886
2015-03-13 10:32:40,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887
2015-03-13 10:32:40,627 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:52991, bytes: 97969, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_252700680_3661, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741899_1075, duration: 298000
2015-03-13 10:32:40,642 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:40,642 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:40,642 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:40,642 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:40,642 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:40,694 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:40,694 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:40,696 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:40,696 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:40,696 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:40,697 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:40,697 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:40,697 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:40,796 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076
2015-03-13 10:32:40,807 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005/default_container_executor.sh]
2015-03-13 10:32:40,807 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002/default_container_executor.sh]
2015-03-13 10:32:40,814 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004/default_container_executor.sh]
2015-03-13 10:32:40,814 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076
2015-03-13 10:32:40,819 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003/default_container_executor.sh]
2015-03-13 10:32:40,843 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889 for deletion
2015-03-13 10:32:40,843 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890 for deletion
2015-03-13 10:32:40,843 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886 for deletion
2015-03-13 10:32:40,843 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887 for deletion
2015-03-13 10:32:40,843 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741889
2015-03-13 10:32:40,844 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741886
2015-03-13 10:32:40,844 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741890
2015-03-13 10:32:40,844 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741887
2015-03-13 10:32:41,061 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076
2015-03-13 10:32:41,109 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,110 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:41,110 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,111 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,111 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0006
2015-03-13 10:32:41,111 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:41,111 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,111 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,111 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0006, with delay of 10800 seconds
2015-03-13 10:32:41,213 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:41,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,214 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0006
2015-03-13 10:32:41,215 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:41,215 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0006, with delay of 10800 seconds
2015-03-13 10:32:41,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0006
2015-03-13 10:32:41,282 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,282 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,282 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,283 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:41,283 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:41,283 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:41,284 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:41,284 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:41,284 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:32:41,671 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:41,786 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426267835672_0007_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005.tokens
2015-03-13 10:32:41,786 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:41,896 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:42,012 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426267835672_0007_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003.tokens
2015-03-13 10:32:42,012 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:42,107 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:42,110 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:42,235 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426267835672_0007_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002.tokens
2015-03-13 10:32:42,236 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:42,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:42,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:42,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:42,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,113 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,288 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:43,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,115 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,294 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,294 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:44,294 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,120 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:45,301 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,125 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:46,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,131 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:47,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:47,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:47,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job.split	dst=null	perm=null
2015-03-13 10:32:47,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,311 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53002, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 201000
2015-03-13 10:32:47,403 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53005, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 162000
2015-03-13 10:32:47,405 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53004, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 170000
2015-03-13 10:32:47,436 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53006, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 512, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741897_1073, duration: 168000
2015-03-13 10:32:47,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:47,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:47,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:47,497 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53004, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 156000
2015-03-13 10:32:47,501 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53007, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 512, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 158000
2015-03-13 10:32:47,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:47,533 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53008, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 178000
2015-03-13 10:32:47,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,753 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53009, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 167000
2015-03-13 10:32:47,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary	dst=null	perm=null
2015-03-13 10:32:47,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary	dst=null	perm=null
2015-03-13 10:32:47,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,806 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:47,815 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:47,846 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077 src: /127.0.0.1:53010 dest: /127.0.0.1:52447
2015-03-13 10:32:47,849 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077 src: /127.0.0.1:53012 dest: /127.0.0.1:52444
2015-03-13 10:32:47,850 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077 src: /127.0.0.1:53013 dest: /127.0.0.1:52451
2015-03-13 10:32:47,859 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078 src: /127.0.0.1:53011 dest: /127.0.0.1:52447
2015-03-13 10:32:47,861 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078 src: /127.0.0.1:53014 dest: /127.0.0.1:52451
2015-03-13 10:32:47,862 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078 src: /127.0.0.1:53015 dest: /127.0.0.1:52454
2015-03-13 10:32:47,863 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53013, dest: /127.0.0.1:52451, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 10859000
2015-03-13 10:32:47,863 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:47,863 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:47,864 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53012, dest: /127.0.0.1:52444, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 11497000
2015-03-13 10:32:47,866 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,866 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:47,867 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53010, dest: /127.0.0.1:52447, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 14983000
2015-03-13 10:32:47,867 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,868 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:47,873 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1
2015-03-13 10:32:47,874 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53015, dest: /127.0.0.1:52454, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 10146000
2015-03-13 10:32:47,874 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:47,875 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,875 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53014, dest: /127.0.0.1:52451, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 9974000
2015-03-13 10:32:47,875 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,875 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53011, dest: /127.0.0.1:52447, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 10226000
2015-03-13 10:32:47,876 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,876 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0	dst=null	perm=null
2015-03-13 10:32:47,881 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1
2015-03-13 10:32:47,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0	dst=null	perm=null
2015-03-13 10:32:47,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0	dst=null	perm=null
2015-03-13 10:32:47,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0	dst=null	perm=null
2015-03-13 10:32:47,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:32:47,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0	dst=null	perm=null
2015-03-13 10:32:47,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:32:47,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:32:47,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:32:47,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:32:47,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:32:47,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0/part-m-00001-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000001_0	dst=null	perm=null
2015-03-13 10:32:47,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:32:47,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0/part-m-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:47,918 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0/part-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:47,920 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079 src: /127.0.0.1:53016 dest: /127.0.0.1:52451
2015-03-13 10:32:47,922 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079 src: /127.0.0.1:53017 dest: /127.0.0.1:52447
2015-03-13 10:32:47,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:32:47,923 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079 src: /127.0.0.1:53018 dest: /127.0.0.1:52454
2015-03-13 10:32:47,926 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53018, dest: /127.0.0.1:52454, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 1638000
2015-03-13 10:32:47,926 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:47,927 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,927 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53017, dest: /127.0.0.1:52447, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 2293000
2015-03-13 10:32:47,927 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,927 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,928 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53016, dest: /127.0.0.1:52451, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 3060000
2015-03-13 10:32:47,928 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,928 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:47,931 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0/part-00001 is closed by DFSClient_attempt_1426267835672_0007_m_000001_0_2049895370_1
2015-03-13 10:32:47,933 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:47,935 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080 src: /127.0.0.1:53019 dest: /127.0.0.1:52444
2015-03-13 10:32:47,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080 src: /127.0.0.1:53020 dest: /127.0.0.1:52451
2015-03-13 10:32:47,938 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080 src: /127.0.0.1:53021 dest: /127.0.0.1:52447
2015-03-13 10:32:47,941 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53021, dest: /127.0.0.1:52447, bytes: 23, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 1361000
2015-03-13 10:32:47,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0	dst=null	perm=null
2015-03-13 10:32:47,941 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:47,942 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:47,942 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53020, dest: /127.0.0.1:52451, bytes: 23, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 2080000
2015-03-13 10:32:47,942 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,942 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:47,943 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53019, dest: /127.0.0.1:52444, bytes: 23, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 2883000
2015-03-13 10:32:47,943 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:47,943 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:47,946 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0007_m_000000_0_1566271060_1
2015-03-13 10:32:47,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0	dst=null	perm=null
2015-03-13 10:32:47,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000001	dst=null	perm=null
2015-03-13 10:32:47,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:32:47,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:32:47,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000000	dst=null	perm=null
2015-03-13 10:32:47,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:47,975 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000002
2015-03-13 10:32:47,975 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000003
2015-03-13 10:32:47,975 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:32:47,975 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:47,975 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000002
2015-03-13 10:32:47,975 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:47,975 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:47,976 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,976 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,976 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:47,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary	dst=null	perm=null
2015-03-13 10:32:47,988 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0007_01_000002 is : 143
2015-03-13 10:32:47,990 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:47,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081 src: /127.0.0.1:53022 dest: /127.0.0.1:52444
2015-03-13 10:32:47,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary	dst=null	perm=null
2015-03-13 10:32:47,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081 src: /127.0.0.1:53023 dest: /127.0.0.1:52451
2015-03-13 10:32:47,995 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081 src: /127.0.0.1:53024 dest: /127.0.0.1:52454
2015-03-13 10:32:47,999 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist for DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:47,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,001 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:32:48,001 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:48,001 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000003
2015-03-13 10:32:48,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,014 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0007_01_000003 is : 143
2015-03-13 10:32:48,020 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:48,029 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:48,030 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002
2015-03-13 10:32:48,029 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002
2015-03-13 10:32:48,029 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002
2015-03-13 10:32:48,029 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000002
2015-03-13 10:32:48,032 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:48,032 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:48,034 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003
2015-03-13 10:32:48,034 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:48,034 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003
2015-03-13 10:32:48,035 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003
2015-03-13 10:32:48,035 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000003
2015-03-13 10:32:48,038 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000002 from application application_1426267835672_0007
2015-03-13 10:32:48,041 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:48,041 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:48,043 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:48,044 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:48,046 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000003 from application application_1426267835672_0007
2015-03-13 10:32:48,048 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:48,048 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:48,064 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082 src: /127.0.0.1:53025 dest: /127.0.0.1:52454
2015-03-13 10:32:48,065 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082 src: /127.0.0.1:53027 dest: /127.0.0.1:52444
2015-03-13 10:32:48,067 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082 src: /127.0.0.1:53028 dest: /127.0.0.1:52451
2015-03-13 10:32:48,079 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53028, dest: /127.0.0.1:52451, bytes: 13, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 10957000
2015-03-13 10:32:48,079 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,080 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,080 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53027, dest: /127.0.0.1:52444, bytes: 13, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 10842000
2015-03-13 10:32:48,080 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,081 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,081 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53025, dest: /127.0.0.1:52454, bytes: 13, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 12179000
2015-03-13 10:32:48,081 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,081 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,084 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083 src: /127.0.0.1:53026 dest: /127.0.0.1:52444
2015-03-13 10:32:48,086 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083 src: /127.0.0.1:53029 dest: /127.0.0.1:52454
2015-03-13 10:32:48,087 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002 is closed by DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1
2015-03-13 10:32:48,088 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083 src: /127.0.0.1:53030 dest: /127.0.0.1:52451
2015-03-13 10:32:48,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0	dst=null	perm=null
2015-03-13 10:32:48,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0	dst=null	perm=null
2015-03-13 10:32:48,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0	dst=null	perm=null
2015-03-13 10:32:48,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0	dst=null	perm=null
2015-03-13 10:32:48,098 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53030, dest: /127.0.0.1:52451, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 9142000
2015-03-13 10:32:48,099 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,099 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,099 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53029, dest: /127.0.0.1:52454, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 9362000
2015-03-13 10:32:48,099 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,100 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,100 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53026, dest: /127.0.0.1:52444, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 10706000
2015-03-13 10:32:48,100 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,100 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0	dst=null	perm=null
2015-03-13 10:32:48,104 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1
2015-03-13 10:32:48,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0	dst=null	perm=null
2015-03-13 10:32:48,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0	dst=null	perm=null
2015-03-13 10:32:48,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0	dst=null	perm=null
2015-03-13 10:32:48,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0	dst=null	perm=null
2015-03-13 10:32:48,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:48,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0	dst=null	perm=null
2015-03-13 10:32:48,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:32:48,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0/part-m-00001-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:48,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000002_0	dst=null	perm=null
2015-03-13 10:32:48,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:32:48,132 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:48,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0/part-m-00001-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,138 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0/part-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:48,140 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084 src: /127.0.0.1:53031 dest: /127.0.0.1:52444
2015-03-13 10:32:48,141 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084 src: /127.0.0.1:53032 dest: /127.0.0.1:52454
2015-03-13 10:32:48,143 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084 src: /127.0.0.1:53033 dest: /127.0.0.1:52447
2015-03-13 10:32:48,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary/_attempt_1426267835672_0007_m_000003_0	dst=null	perm=null
2015-03-13 10:32:48,145 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53033, dest: /127.0.0.1:52447, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 1122000
2015-03-13 10:32:48,146 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,146 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,146 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53032, dest: /127.0.0.1:52454, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 1610000
2015-03-13 10:32:48,146 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,147 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,147 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53031, dest: /127.0.0.1:52444, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 2414000
2015-03-13 10:32:48,147 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,148 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,150 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0/part-00002 is closed by DFSClient_attempt_1426267835672_0007_m_000002_0_1868452729_1
2015-03-13 10:32:48,155 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0/part-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:48,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085 src: /127.0.0.1:53034 dest: /127.0.0.1:52444
2015-03-13 10:32:48,158 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085 src: /127.0.0.1:53035 dest: /127.0.0.1:52454
2015-03-13 10:32:48,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085 src: /127.0.0.1:53036 dest: /127.0.0.1:52451
2015-03-13 10:32:48,162 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53036, dest: /127.0.0.1:52451, bytes: 22, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 1382000
2015-03-13 10:32:48,163 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,163 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,163 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53035, dest: /127.0.0.1:52454, bytes: 22, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 1958000
2015-03-13 10:32:48,163 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,164 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,164 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53034, dest: /127.0.0.1:52444, bytes: 22, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 2766000
2015-03-13 10:32:48,164 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,165 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:48,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0	dst=null	perm=null
2015-03-13 10:32:48,168 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0/part-00003 is closed by DFSClient_attempt_1426267835672_0007_m_000003_0_1458553179_1
2015-03-13 10:32:48,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0	dst=null	perm=null
2015-03-13 10:32:48,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000002	dst=null	perm=null
2015-03-13 10:32:48,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:48,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0	dst=null	perm=null
2015-03-13 10:32:48,190 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000004
2015-03-13 10:32:48,190 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:48,190 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:32:48,190 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:48,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000002
2015-03-13 10:32:48,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:48,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000003
2015-03-13 10:32:48,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:32:48,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:48,193 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:48,194 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:32:48,194 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000002
2015-03-13 10:32:48,194 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:32:48,194 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:32:48,194 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000002, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:48,194 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:48,194 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:32:48,194 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000002 on node: host: 10.1.1.144:52469 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:32:48,194 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:48,194 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:32:48,195 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000003
2015-03-13 10:32:48,195 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:32:48,195 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:32:48,195 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000003, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:48,195 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:48,195 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:32:48,195 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000003 on node: host: 10.1.1.144:52469 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:32:48,196 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000004
2015-03-13 10:32:48,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0	dst=null	perm=null
2015-03-13 10:32:48,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000003	dst=null	perm=null
2015-03-13 10:32:48,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/_temporary/attempt_1426267835672_0007_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:48,211 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0007_01_000004 is : 143
2015-03-13 10:32:48,220 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000005
2015-03-13 10:32:48,220 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:48,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:32:48,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:48,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,226 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,229 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:48,229 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:32:48,230 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004
2015-03-13 10:32:48,230 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004
2015-03-13 10:32:48,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1	dst=null	perm=null
2015-03-13 10:32:48,230 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004
2015-03-13 10:32:48,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000004
2015-03-13 10:32:48,231 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000005
2015-03-13 10:32:48,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:48,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:48,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000000	dst=null	perm=null
2015-03-13 10:32:48,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000	dst=null	perm=null
2015-03-13 10:32:48,245 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0007_01_000005 is : 143
2015-03-13 10:32:48,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:48,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:48,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000001	dst=null	perm=null
2015-03-13 10:32:48,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001	dst=null	perm=null
2015-03-13 10:32:48,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:48,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:48,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000002	dst=null	perm=null
2015-03-13 10:32:48,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002	dst=null	perm=null
2015-03-13 10:32:48,259 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:48,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,260 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:48,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:48,263 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:32:48,263 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000004 from application application_1426267835672_0007
2015-03-13 10:32:48,263 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:48,263 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:48,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:48,264 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005
2015-03-13 10:32:48,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000003	dst=null	perm=null
2015-03-13 10:32:48,265 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005
2015-03-13 10:32:48,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003	dst=null	perm=null
2015-03-13 10:32:48,267 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005
2015-03-13 10:32:48,268 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000005
2015-03-13 10:32:48,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary/1/task_1426267835672_0007_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,269 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:48,269 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:32:48,270 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000005 from application application_1426267835672_0007
2015-03-13 10:32:48,270 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:48,271 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:48,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary	dst=null	perm=null
2015-03-13 10:32:48,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,279 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,283 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53024, dest: /127.0.0.1:52454, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, duration: 298846000
2015-03-13 10:32:48,295 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,298 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:48,298 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53023, dest: /127.0.0.1:52451, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, duration: 301425000
2015-03-13 10:32:48,298 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,298 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:48,299 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53022, dest: /127.0.0.1:52444, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, duration: 302292000
2015-03-13 10:32:48,299 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,299 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:48,300 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,304 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:48,306 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086 src: /127.0.0.1:53037 dest: /127.0.0.1:52451
2015-03-13 10:32:48,308 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086 src: /127.0.0.1:53038 dest: /127.0.0.1:52454
2015-03-13 10:32:48,309 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086 src: /127.0.0.1:53039 dest: /127.0.0.1:52444
2015-03-13 10:32:48,313 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53039, dest: /127.0.0.1:52444, bytes: 438, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, duration: 1942000
2015-03-13 10:32:48,313 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,315 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53038, dest: /127.0.0.1:52454, bytes: 438, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, duration: 3018000
2015-03-13 10:32:48,315 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,315 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:48,316 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53037, dest: /127.0.0.1:52451, bytes: 438, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, duration: 4760000
2015-03-13 10:32:48,316 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,317 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:48,317 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:48,320 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist	dst=null	perm=null
2015-03-13 10:32:48,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:32:48,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist	dst=null	perm=null
2015-03-13 10:32:48,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:32:48,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1.jhist	dst=null	perm=null
2015-03-13 10:32:48,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,342 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53040, bytes: 47461, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081, duration: 220000
2015-03-13 10:32:48,343 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:48,345 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087 src: /127.0.0.1:53041 dest: /127.0.0.1:52451
2015-03-13 10:32:48,352 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087 src: /127.0.0.1:53042 dest: /127.0.0.1:52444
2015-03-13 10:32:48,353 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087 src: /127.0.0.1:53043 dest: /127.0.0.1:52447
2015-03-13 10:32:48,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53043, dest: /127.0.0.1:52447, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, duration: 1739000
2015-03-13 10:32:48,357 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,357 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53042, dest: /127.0.0.1:52444, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, duration: 2421000
2015-03-13 10:32:48,358 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,358 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,358 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53041, dest: /127.0.0.1:52451, bytes: 47093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, duration: 3375000
2015-03-13 10:32:48,358 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,359 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,360 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:48,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:32:48,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:48,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:32:48,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007/job_1426267835672_0007_1_conf.xml	dst=null	perm=null
2015-03-13 10:32:48,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:48,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53044, bytes: 90690, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741900_1076, duration: 345000
2015-03-13 10:32:48,375 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:32:48,377 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088 src: /127.0.0.1:53045 dest: /127.0.0.1:52454
2015-03-13 10:32:48,379 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088 src: /127.0.0.1:53046 dest: /127.0.0.1:52444
2015-03-13 10:32:48,380 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088 src: /127.0.0.1:53047 dest: /127.0.0.1:52447
2015-03-13 10:32:48,384 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53047, dest: /127.0.0.1:52447, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, duration: 1685000
2015-03-13 10:32:48,384 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:48,384 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,385 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53046, dest: /127.0.0.1:52444, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, duration: 2345000
2015-03-13 10:32:48,385 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,385 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,385 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53045, dest: /127.0.0.1:52454, bytes: 89986, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1028549147_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, duration: 3176000
2015-03-13 10:32:48,386 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:48,386 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:32:48,388 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1028549147_1
2015-03-13 10:32:48,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:32:48,402 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from RUNNING to FINISHING
2015-03-13 10:32:48,402 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0007
2015-03-13 10:32:48,402 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from RUNNING to REMOVING
2015-03-13 10:32:48,402 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0007
2015-03-13 10:32:48,402 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from REMOVING to FINISHING
2015-03-13 10:32:49,135 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:49,226 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:49,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000004
2015-03-13 10:32:49,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:32:49,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000005
2015-03-13 10:32:49,228 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:49,228 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:32:49,228 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000004
2015-03-13 10:32:49,229 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:32:49,229 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:32:49,229 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000004, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:49,229 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:49,230 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:32:49,230 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000004 on node: host: 10.1.1.144:52469 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:32:49,230 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:49,230 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:32:49,230 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000005
2015-03-13 10:32:49,230 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52469, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:32:49,231 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:32:49,231 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000005, NodeId: 10.1.1.144:52469, NodeHttpAddress: 10.1.1.144:52472, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52469 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:49,231 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:49,231 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:32:49,231 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000005 on node: host: 10.1.1.144:52469 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:32:49,408 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741896_1072 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52447 
2015-03-13 10:32:49,408 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741897_1073 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52447 
2015-03-13 10:32:49,408 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741898_1074 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52451 
2015-03-13 10:32:49,408 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741899_1075 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52451 
2015-03-13 10:32:49,408 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741905_1081 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454 
2015-03-13 10:32:49,409 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741900_1076 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:32:49,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0007	dst=null	perm=null
2015-03-13 10:32:49,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,445 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary
2015-03-13 10:32:49,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/_temporary	dst=null	perm=null
2015-03-13 10:32:49,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,446 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary
2015-03-13 10:32:49,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary	dst=null	perm=null
2015-03-13 10:32:49,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/_temporary	dst=null	perm=null
2015-03-13 10:32:49,456 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:49,456 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:49,456 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:49,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,460 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:32:49,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000	dst=null	perm=null
2015-03-13 10:32:49,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53049, bytes: 27, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 148000
2015-03-13 10:32:49,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001	dst=null	perm=null
2015-03-13 10:32:49,466 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 47, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 160000
2015-03-13 10:32:49,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002	dst=null	perm=null
2015-03-13 10:32:49,469 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53049, bytes: 47, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 172000
2015-03-13 10:32:49,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003	dst=null	perm=null
2015-03-13 10:32:49,471 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 26, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 152000
2015-03-13 10:32:49,484 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:49,484 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:49,485 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:49,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,489 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:32:49,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:32:49,492 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 19, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 149000
2015-03-13 10:32:49,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:32:49,494 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 120000
2015-03-13 10:32:49,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:32:49,496 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 17, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 120000
2015-03-13 10:32:49,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:32:49,498 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 19, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 121000
2015-03-13 10:32:49,498 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/allchain/trap-nondeterministic
2015-03-13 10:32:49,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:32:49,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:32:49,503 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 19, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078, duration: 188000
2015-03-13 10:32:49,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:32:49,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:32:49,507 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53052, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077, duration: 185000
2015-03-13 10:32:49,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:32:49,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:32:49,509 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 17, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082, duration: 152000
2015-03-13 10:32:49,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:32:49,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/trap-nondeterministic/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:32:49,512 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 19, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083, duration: 157000
2015-03-13 10:32:49,513 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/allchain/tap-nondeterministic
2015-03-13 10:32:49,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic	dst=null	perm=null
2015-03-13 10:32:49,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000	dst=null	perm=null
2015-03-13 10:32:49,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00000	dst=null	perm=null
2015-03-13 10:32:49,520 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53049, bytes: 27, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080, duration: 151000
2015-03-13 10:32:49,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001	dst=null	perm=null
2015-03-13 10:32:49,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00001	dst=null	perm=null
2015-03-13 10:32:49,523 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53052, bytes: 47, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079, duration: 125000
2015-03-13 10:32:49,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002	dst=null	perm=null
2015-03-13 10:32:49,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00002	dst=null	perm=null
2015-03-13 10:32:49,526 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53049, bytes: 47, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084, duration: 128000
2015-03-13 10:32:49,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003	dst=null	perm=null
2015-03-13 10:32:49,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allchain/tap-nondeterministic/part-00003	dst=null	perm=null
2015-03-13 10:32:49,529 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 26, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085, duration: 125000
2015-03-13 10:32:49,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:49,541 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:49,542 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:32:49,543 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:32:49,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:32:49,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:32:49,559 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:32:49,560 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:32:49,560 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap"]
2015-03-13 10:32:49,560 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:32:49,560 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:32:49,560 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:32:49,561 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...-mr1/trapplatform/seq/tap
2015-03-13 10:32:49,569 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:49,577 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:49,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:32:49,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:49,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:49,583 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 8
2015-03-13 10:32:49,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008	dst=null	perm=null
2015-03-13 10:32:49,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:32:49,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:32:49,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:49,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,590 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:49,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53054 dest: /127.0.0.1:52454
2015-03-13 10:32:49,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53055 dest: /127.0.0.1:52451
2015-03-13 10:32:49,593 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53056 dest: /127.0.0.1:52444
2015-03-13 10:32:49,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53056, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 2618000
2015-03-13 10:32:49,597 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:49,598 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,598 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53055, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 2623000
2015-03-13 10:32:49,598 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,598 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,599 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53054, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 3523000
2015-03-13 10:32:49,599 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,600 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,601 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:49,601 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar
2015-03-13 10:32:49,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:49,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:49,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:49,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:49,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:32:49,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:32:49,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:32:49,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:32:49,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:32:49,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:49,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:49,610 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:32:49,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:32:49,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,615 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split
2015-03-13 10:32:49,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:32:49,616 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:32:49,617 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090 src: /127.0.0.1:53057 dest: /127.0.0.1:52451
2015-03-13 10:32:49,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090 src: /127.0.0.1:53058 dest: /127.0.0.1:52444
2015-03-13 10:32:49,620 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090 src: /127.0.0.1:53059 dest: /127.0.0.1:52447
2015-03-13 10:32:49,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090 src: /127.0.0.1:53060 dest: /127.0.0.1:52454
2015-03-13 10:32:49,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53060, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 1744000
2015-03-13 10:32:49,624 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:49,625 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:49,625 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53059, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 2205000
2015-03-13 10:32:49,625 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,625 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:49,626 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53058, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 3207000
2015-03-13 10:32:49,626 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,626 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:49,626 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53057, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 3693000
2015-03-13 10:32:49,627 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,628 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:32:49,628 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:49,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,633 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:32:49,634 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091 src: /127.0.0.1:53061 dest: /127.0.0.1:52444
2015-03-13 10:32:49,636 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091 src: /127.0.0.1:53062 dest: /127.0.0.1:52454
2015-03-13 10:32:49,637 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091 src: /127.0.0.1:53063 dest: /127.0.0.1:52451
2015-03-13 10:32:49,640 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53063, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 1155000
2015-03-13 10:32:49,640 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:49,640 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:49,640 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53062, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 1468000
2015-03-13 10:32:49,641 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,641 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:49,641 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53061, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 2308000
2015-03-13 10:32:49,642 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:32:49,643 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:49,644 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:32:49,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:32:49,647 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:32:49,648 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:32:49,648 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:32:49,652 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:49,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092 src: /127.0.0.1:53064 dest: /127.0.0.1:52454
2015-03-13 10:32:49,654 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092 src: /127.0.0.1:53065 dest: /127.0.0.1:52451
2015-03-13 10:32:49,655 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092 src: /127.0.0.1:53066 dest: /127.0.0.1:52444
2015-03-13 10:32:49,658 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53066, dest: /127.0.0.1:52444, bytes: 98752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 1652000
2015-03-13 10:32:49,659 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:49,659 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,659 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53065, dest: /127.0.0.1:52451, bytes: 98752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 2269000
2015-03-13 10:32:49,660 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,660 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53064, dest: /127.0.0.1:52454, bytes: 98752, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 3083000
2015-03-13 10:32:49,660 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:49,661 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:49,662 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:32:49,662 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0008
2015-03-13 10:32:49,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008	dst=null	perm=null
2015-03-13 10:32:49,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:49,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:49,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:49,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:49,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:32:49,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:32:49,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:49,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:49,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:49,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:49,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:49,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:49,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:49,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:49,680 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 8 submitted by user soberoi
2015-03-13 10:32:49,680 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0008
2015-03-13 10:32:49,680 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0008
2015-03-13 10:32:49,681 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0008
2015-03-13 10:32:49,681 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from NEW to NEW_SAVING
2015-03-13 10:32:49,681 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:32:49,681 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0008_000001
2015-03-13 10:32:49,681 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from NEW to SUBMITTED
2015-03-13 10:32:49,682 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0008 from user: soberoi activated in queue: default
2015-03-13 10:32:49,682 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0008 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:32:49,682 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0008 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:32:49,682 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0008 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:32:49,682 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0008_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:32:49,682 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:32:49,683 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from SUBMITTED to ACCEPTED
2015-03-13 10:32:49,685 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0008/
2015-03-13 10:32:49,685 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0008
2015-03-13 10:32:49,685 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0008/
2015-03-13 10:32:50,139 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:50,140 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:50,140 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000001
2015-03-13 10:32:50,140 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:32:50,141 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0008_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:50,141 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:32:50,141 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:50,141 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:50,142 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0008 AttemptId: appattempt_1426267835672_0008_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:32:50,142 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:32:50,143 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0008_000001
2015-03-13 10:32:50,143 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:32:50,143 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0008_000001
2015-03-13 10:32:50,143 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0008_000001
2015-03-13 10:32:50,144 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0008_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:32:50,146 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:32:50,148 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000001 by user soberoi
2015-03-13 10:32:50,148 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0008
2015-03-13 10:32:50,148 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000001
2015-03-13 10:32:50,148 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from NEW to INITING
2015-03-13 10:32:50,148 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000001 to application application_1426267835672_0008
2015-03-13 10:32:50,149 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0008_000001
2015-03-13 10:32:50,149 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from INITING to RUNNING
2015-03-13 10:32:50,149 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:32:50,149 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:32:50,149 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:50,149 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:50,149 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:32:50,149 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:32:50,150 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:50,150 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000001
2015-03-13 10:32:50,160 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426267835672_0008_01_000001.tokens. Credentials list: 
2015-03-13 10:32:50,175 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:50,246 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426267835672_0008_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001.tokens
2015-03-13 10:32:50,246 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:50,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:50,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:50,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:50,314 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-341290720_4041, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 438000
2015-03-13 10:32:50,332 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:50,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:50,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:50,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:50,355 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-341290720_4041, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 177000
2015-03-13 10:32:50,367 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:50,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:32:50,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:32:50,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:32:50,390 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53051, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-341290720_4041, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 159000
2015-03-13 10:32:50,402 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:50,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:50,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:50,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:50,425 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53050, bytes: 99524, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-341290720_4041, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 253000
2015-03-13 10:32:50,437 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:50,437 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:50,463 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:50,463 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:50,529 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001/default_container_executor.sh]
2015-03-13 10:32:50,806 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089
2015-03-13 10:32:50,806 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081
2015-03-13 10:32:50,807 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084
2015-03-13 10:32:50,819 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079
2015-03-13 10:32:50,820 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084
2015-03-13 10:32:50,820 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087
2015-03-13 10:32:50,821 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088
2015-03-13 10:32:50,821 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078
2015-03-13 10:32:50,822 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077
2015-03-13 10:32:50,822 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080
2015-03-13 10:32:50,822 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090
2015-03-13 10:32:51,010 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092
2015-03-13 10:32:51,010 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079
2015-03-13 10:32:51,011 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078
2015-03-13 10:32:51,011 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085
2015-03-13 10:32:51,012 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090
2015-03-13 10:32:51,012 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091
2015-03-13 10:32:51,012 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086
2015-03-13 10:32:51,013 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083
2015-03-13 10:32:51,013 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082
2015-03-13 10:32:51,014 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088
2015-03-13 10:32:51,045 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082
2015-03-13 10:32:51,045 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083
2015-03-13 10:32:51,068 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080
2015-03-13 10:32:51,069 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090
2015-03-13 10:32:51,070 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089
2015-03-13 10:32:51,071 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741903_1079
2015-03-13 10:32:51,071 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086
2015-03-13 10:32:51,071 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091
2015-03-13 10:32:51,072 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087
2015-03-13 10:32:51,072 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741907_1083
2015-03-13 10:32:51,072 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077
2015-03-13 10:32:51,073 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741902_1078
2015-03-13 10:32:51,073 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085
2015-03-13 10:32:51,073 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081
2015-03-13 10:32:51,074 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741906_1082
2015-03-13 10:32:51,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:51,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:51,143 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:51,250 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089
2015-03-13 10:32:51,250 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090
2015-03-13 10:32:51,251 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741904_1080
2015-03-13 10:32:51,252 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741912_1088
2015-03-13 10:32:51,252 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741905_1081
2015-03-13 10:32:51,253 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086
2015-03-13 10:32:51,254 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741911_1087
2015-03-13 10:32:51,271 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092
2015-03-13 10:32:51,445 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091
2015-03-13 10:32:51,446 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092
2015-03-13 10:32:51,446 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741901_1077
2015-03-13 10:32:51,447 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741909_1085
2015-03-13 10:32:51,447 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741908_1084
2015-03-13 10:32:51,976 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52454 to replicate blk_1073741913_1089 to datanode(s) 127.0.0.1:52447
2015-03-13 10:32:51,976 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741905_1081, blk_1073741896_1072, blk_1073741897_1073, blk_1073741899_1075, blk_1073741900_1076]
2015-03-13 10:32:51,977 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741905_1081, blk_1073741896_1072, blk_1073741897_1073, blk_1073741898_1074]
2015-03-13 10:32:52,146 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:52,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:52,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:32:52,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:32:52,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:32:52,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:32:52,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008	dst=null	perm=null
2015-03-13 10:32:52,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:32:52,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:32:52,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:52,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:32:52,625 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905 for deletion
2015-03-13 10:32:52,625 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896 for deletion
2015-03-13 10:32:52,625 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897 for deletion
2015-03-13 10:32:52,625 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905
2015-03-13 10:32:52,625 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896
2015-03-13 10:32:52,625 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897
2015-03-13 10:32:52,625 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898 for deletion
2015-03-13 10:32:52,626 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898
2015-03-13 10:32:52,628 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53071, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741915_1091, duration: 187000
2015-03-13 10:32:53,003 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1285499800-10.1.1.144-52454-1426267834827, infoPort=52455, ipcPort=52456, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 to 127.0.0.1:52447 
2015-03-13 10:32:53,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905 for deletion
2015-03-13 10:32:53,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896 for deletion
2015-03-13 10:32:53,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897 for deletion
2015-03-13 10:32:53,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899 for deletion
2015-03-13 10:32:53,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905
2015-03-13 10:32:53,005 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896
2015-03-13 10:32:53,005 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897
2015-03-13 10:32:53,005 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899
2015-03-13 10:32:53,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900 for deletion
2015-03-13 10:32:53,005 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 (numBytes=254067) to /127.0.0.1:52447
2015-03-13 10:32:53,005 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53074 dest: /127.0.0.1:52447
2015-03-13 10:32:53,006 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900
2015-03-13 10:32:53,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089 src: /127.0.0.1:53074 dest: /127.0.0.1:52447 of size 254067
2015-03-13 10:32:53,008 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741913_1089 size 254067
2015-03-13 10:32:53,148 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:53,148 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:53,420 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:32:53,422 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0008_000001
2015-03-13 10:32:53,422 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0008	APPATTEMPTID=appattempt_1426267835672_0008_000001
2015-03-13 10:32:53,422 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:32:53,422 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from ACCEPTED to RUNNING
2015-03-13 10:32:53,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:53,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:32:53,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:32:53,646 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:32:53,689 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093 src: /127.0.0.1:53078 dest: /127.0.0.1:52451
2015-03-13 10:32:53,690 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093 src: /127.0.0.1:53079 dest: /127.0.0.1:52454
2015-03-13 10:32:53,692 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093 src: /127.0.0.1:53080 dest: /127.0.0.1:52444
2015-03-13 10:32:53,699 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53080, dest: /127.0.0.1:52444, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, duration: 5758000
2015-03-13 10:32:53,699 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:32:53,700 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:53,700 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53079, dest: /127.0.0.1:52454, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, duration: 6660000
2015-03-13 10:32:53,700 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:53,701 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53078, dest: /127.0.0.1:52451, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, duration: 7518000
2015-03-13 10:32:53,701 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:53,701 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:32:53,702 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:32:53,705 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:32:54,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:54,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:54,543 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0007_01_000001 succeeded 
2015-03-13 10:32:54,543 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:32:54,543 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0007_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:32:54,551 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0007_01_000001 from application application_1426267835672_0007
2015-03-13 10:32:54,552 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:54,552 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0007
2015-03-13 10:32:54,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001
2015-03-13 10:32:54,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0007/container_1426267835672_0007_01_000001
2015-03-13 10:32:54,643 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:54,643 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:32:54,644 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:32:54,644 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0008_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,644 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:32:54,644 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,645 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:54,645 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:32:54,645 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:32:54,646 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000003, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0008_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,646 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:32:54,646 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:54,646 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:32:54,646 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:32:54,646 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000004, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0008_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,647 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:32:54,647 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,647 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:32:54,647 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:32:54,647 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:32:54,647 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000005, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0008_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,647 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:32:54,647 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:54,983 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741905_1081, blk_1073741896_1072, blk_1073741897_1073, blk_1073741898_1074, blk_1073741899_1075, blk_1073741900_1076]
2015-03-13 10:32:54,983 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741896_1072, blk_1073741897_1073, blk_1073741898_1074, blk_1073741899_1075, blk_1073741900_1076]
2015-03-13 10:32:55,154 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:32:55,154 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0007_01_000001
2015-03-13 10:32:55,155 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,155 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0007_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:32:55,156 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0007_000001
2015-03-13 10:32:55,156 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0007_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:32:55,156 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0007_000001 State change from FINISHING to FINISHED
2015-03-13 10:32:55,156 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0007	CONTAINERID=container_1426267835672_0007_01_000001
2015-03-13 10:32:55,156 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0007 State change from FINISHING to FINISHED
2015-03-13 10:32:55,156 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:32:55,157 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0007
2015-03-13 10:32:55,157 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:32:55,157 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0007,name=[F2851B067A5340D8BCD42F553ADE00B9/2D32D0260D4B4807B8F7ECFBFF3D0CCC] trap test/(1/1) ...hain/tap-nondeterministic,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0007/jobhistory/job/job_1426267835672_0007,appMasterHost=Edinburgh.local,startTime=1426267954642,finishTime=1426267968402,finalStatus=SUCCEEDED
2015-03-13 10:32:55,157 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0007_000001
2015-03-13 10:32:55,157 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0007_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:55,157 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:32:55,158 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:32:55,158 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0007_000001 released container container_1426267835672_0007_01_000001 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:32:55,158 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0007_000001 is done. finalState=FINISHED
2015-03-13 10:32:55,158 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0007 requests cleared
2015-03-13 10:32:55,158 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0007 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:32:55,158 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0007 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:32:55,160 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0007_000001 (auth:SIMPLE)
2015-03-13 10:32:55,162 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0007_01_000001
2015-03-13 10:32:55,242 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:55,242 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:55,243 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0007
2015-03-13 10:32:55,243 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:55,243 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:55,243 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0007, with delay of 10800 seconds
2015-03-13 10:32:55,243 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:55,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:55,461 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:55,462 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:55,462 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:55,462 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:32:55,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:55,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:55,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:55,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:55,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:55,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:55,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:55,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:55,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:32:55,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:32:55,587 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:32:55,590 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000004 by user soberoi
2015-03-13 10:32:55,590 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000005 by user soberoi
2015-03-13 10:32:55,590 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000003 by user soberoi
2015-03-13 10:32:55,591 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000005 to application application_1426267835672_0008
2015-03-13 10:32:55,591 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:32:55,590 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000002 by user soberoi
2015-03-13 10:32:55,601 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:32:55,590 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0008
2015-03-13 10:32:55,601 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:32:55,591 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000003 to application application_1426267835672_0008
2015-03-13 10:32:55,602 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000002 to application application_1426267835672_0008
2015-03-13 10:32:55,602 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from NEW to INITING
2015-03-13 10:32:55,602 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000004 to application application_1426267835672_0008
2015-03-13 10:32:55,602 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from INITING to RUNNING
2015-03-13 10:32:55,591 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:32:55,602 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:32:55,603 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:32:55,603 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:32:55,603 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:32:55,603 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,603 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,603 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:55,603 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:32:55,604 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:32:55,604 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:32:55,604 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,604 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,604 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:55,604 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:32:55,604 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,604 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,605 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:55,605 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:32:55,605 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,605 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:32:55,605 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:32:55,605 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:32:55,605 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000002
2015-03-13 10:32:55,606 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000004
2015-03-13 10:32:55,607 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000005
2015-03-13 10:32:55,608 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0008_01_000003
2015-03-13 10:32:55,627 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0008_01_000002.tokens. Credentials list: 
2015-03-13 10:32:55,627 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0008_01_000005.tokens. Credentials list: 
2015-03-13 10:32:55,627 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0008_01_000003.tokens. Credentials list: 
2015-03-13 10:32:55,627 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896 for deletion
2015-03-13 10:32:55,627 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0008_01_000004.tokens. Credentials list: 
2015-03-13 10:32:55,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897 for deletion
2015-03-13 10:32:55,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898 for deletion
2015-03-13 10:32:55,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899 for deletion
2015-03-13 10:32:55,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896
2015-03-13 10:32:55,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900 for deletion
2015-03-13 10:32:55,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897
2015-03-13 10:32:55,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898
2015-03-13 10:32:55,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899
2015-03-13 10:32:55,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900
2015-03-13 10:32:55,644 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:55,644 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:55,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:55,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:55,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:55,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:32:55,714 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0008_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002.tokens
2015-03-13 10:32:55,714 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:55,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:55,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:55,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar	dst=null	perm=null
2015-03-13 10:32:55,785 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53085, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1146162549_4153, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089, duration: 468000
2015-03-13 10:32:55,804 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:55,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:55,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:55,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml	dst=null	perm=null
2015-03-13 10:32:55,827 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741913_1089
2015-03-13 10:32:55,828 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53085, bytes: 99524, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1146162549_4153, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741916_1092, duration: 298000
2015-03-13 10:32:55,842 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:32:55,842 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:55,842 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:55,843 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:55,843 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:32:55,861 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905 for deletion
2015-03-13 10:32:55,862 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896 for deletion
2015-03-13 10:32:55,862 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897 for deletion
2015-03-13 10:32:55,862 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898 for deletion
2015-03-13 10:32:55,862 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899 for deletion
2015-03-13 10:32:55,862 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900 for deletion
2015-03-13 10:32:55,863 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741905
2015-03-13 10:32:55,863 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741896_1072 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741896
2015-03-13 10:32:55,863 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741898
2015-03-13 10:32:55,863 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741900_1076 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741900
2015-03-13 10:32:55,863 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741897
2015-03-13 10:32:55,864 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741899
2015-03-13 10:32:55,886 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:55,886 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:55,886 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:55,886 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:55,887 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:55,887 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:32:55,887 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:55,887 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:32:55,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004/default_container_executor.sh]
2015-03-13 10:32:55,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002/default_container_executor.sh]
2015-03-13 10:32:55,996 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003/default_container_executor.sh]
2015-03-13 10:32:55,996 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005/default_container_executor.sh]
2015-03-13 10:32:56,022 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093
2015-03-13 10:32:56,160 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,161 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:32:56,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:56,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:56,161 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0007
2015-03-13 10:32:56,161 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:32:56,161 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0007, with delay of 10800 seconds
2015-03-13 10:32:56,162 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:56,162 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0007
2015-03-13 10:32:56,275 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093
2015-03-13 10:32:56,451 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093
2015-03-13 10:32:56,477 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:32:56,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,652 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,652 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:56,870 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:56,993 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0008_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004.tokens
2015-03-13 10:32:56,994 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:57,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:57,162 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:57,219 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0008_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003.tokens
2015-03-13 10:32:57,219 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:57,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:32:57,438 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426267835672_0008_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005.tokens
2015-03-13 10:32:57,438 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:32:57,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:57,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:57,655 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:57,655 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,165 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,660 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,661 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,661 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:58,661 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,171 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,665 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,665 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,665 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:32:59,666 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,174 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,668 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,669 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,669 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:00,669 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,176 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,674 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:01,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,178 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:33:02,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:33:02,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:33:02,353 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53096, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 172000
2015-03-13 10:33:02,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job.split	dst=null	perm=null
2015-03-13 10:33:02,381 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53097, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 169000
2015-03-13 10:33:02,440 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53099, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 122000
2015-03-13 10:33:02,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:02,479 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53101, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 247000
2015-03-13 10:33:02,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:02,503 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53100, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741914_1090, duration: 156000
2015-03-13 10:33:02,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:02,548 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53102, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 636000
2015-03-13 10:33:02,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:02,595 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53100, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 512, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 165000
2015-03-13 10:33:02,676 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,677 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,677 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,677 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:02,900 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53097, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 167000
2015-03-13 10:33:02,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:02,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:02,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:02,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:02,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:02,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:02,961 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:02,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:02,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:02,986 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:03,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094 src: /127.0.0.1:53103 dest: /127.0.0.1:52444
2015-03-13 10:33:03,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094 src: /127.0.0.1:53105 dest: /127.0.0.1:52454
2015-03-13 10:33:03,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094 src: /127.0.0.1:53106 dest: /127.0.0.1:52451
2015-03-13 10:33:03,020 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53106, dest: /127.0.0.1:52451, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 7084000
2015-03-13 10:33:03,020 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:03,020 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,021 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53105, dest: /127.0.0.1:52454, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 7933000
2015-03-13 10:33:03,021 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,021 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,021 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53103, dest: /127.0.0.1:52444, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 8819000
2015-03-13 10:33:03,022 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,022 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,026 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0008_m_000000_0_-2144035487_1
2015-03-13 10:33:03,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0	dst=null	perm=null
2015-03-13 10:33:03,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0	dst=null	perm=null
2015-03-13 10:33:03,033 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095 src: /127.0.0.1:53104 dest: /127.0.0.1:52444
2015-03-13 10:33:03,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0	dst=null	perm=null
2015-03-13 10:33:03,035 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095 src: /127.0.0.1:53107 dest: /127.0.0.1:52451
2015-03-13 10:33:03,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0	dst=null	perm=null
2015-03-13 10:33:03,036 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095 src: /127.0.0.1:53108 dest: /127.0.0.1:52447
2015-03-13 10:33:03,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0	dst=null	perm=null
2015-03-13 10:33:03,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53108, dest: /127.0.0.1:52447, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 6788000
2015-03-13 10:33:03,045 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:03,045 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:03,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53107, dest: /127.0.0.1:52451, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 7047000
2015-03-13 10:33:03,046 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,046 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:03,046 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53104, dest: /127.0.0.1:52444, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 8555000
2015-03-13 10:33:03,047 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,047 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:03,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:03,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:33:03,051 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0008_m_000001_0_-714393093_1
2015-03-13 10:33:03,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0/part-m-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0	dst=null	perm=null
2015-03-13 10:33:03,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0	dst=null	perm=null
2015-03-13 10:33:03,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0	dst=null	perm=null
2015-03-13 10:33:03,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0	dst=null	perm=null
2015-03-13 10:33:03,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000000_0	dst=null	perm=null
2015-03-13 10:33:03,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0	dst=null	perm=null
2015-03-13 10:33:03,066 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:03,069 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:03,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_m_000000_0	dst=null	perm=null
2015-03-13 10:33:03,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:03,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:33:03,125 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096 src: /127.0.0.1:53109 dest: /127.0.0.1:52447
2015-03-13 10:33:03,127 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096 src: /127.0.0.1:53111 dest: /127.0.0.1:52444
2015-03-13 10:33:03,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0/part-m-00001-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,128 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096 src: /127.0.0.1:53112 dest: /127.0.0.1:52451
2015-03-13 10:33:03,140 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53112, dest: /127.0.0.1:52451, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 9754000
2015-03-13 10:33:03,144 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:03,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097 src: /127.0.0.1:53110 dest: /127.0.0.1:52447
2015-03-13 10:33:03,145 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,145 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53111, dest: /127.0.0.1:52444, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 14895000
2015-03-13 10:33:03,146 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,146 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,146 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53109, dest: /127.0.0.1:52447, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 15996000
2015-03-13 10:33:03,146 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,147 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097 src: /127.0.0.1:53113 dest: /127.0.0.1:52444
2015-03-13 10:33:03,147 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,148 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097 src: /127.0.0.1:53114 dest: /127.0.0.1:52451
2015-03-13 10:33:03,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000001_0	dst=null	perm=null
2015-03-13 10:33:03,157 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002 is closed by DFSClient_attempt_1426267835672_0008_m_000002_0_170542643_1
2015-03-13 10:33:03,159 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000002
2015-03-13 10:33:03,160 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:33:03,160 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:33:03,160 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000002
2015-03-13 10:33:03,160 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:03,160 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,172 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000002 is : 143
2015-03-13 10:33:03,174 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:03,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098 src: /127.0.0.1:53115 dest: /127.0.0.1:52444
2015-03-13 10:33:03,178 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098 src: /127.0.0.1:53116 dest: /127.0.0.1:52451
2015-03-13 10:33:03,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,179 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098 src: /127.0.0.1:53117 dest: /127.0.0.1:52454
2015-03-13 10:33:03,186 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist for DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:03,187 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:03,188 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002
2015-03-13 10:33:03,188 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002
2015-03-13 10:33:03,188 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:33:03,188 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:03,188 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000002 from application application_1426267835672_0008
2015-03-13 10:33:03,189 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:03,189 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:03,189 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002
2015-03-13 10:33:03,189 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000002
2015-03-13 10:33:03,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0	dst=null	perm=null
2015-03-13 10:33:03,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0	dst=null	perm=null
2015-03-13 10:33:03,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0	dst=null	perm=null
2015-03-13 10:33:03,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0	dst=null	perm=null
2015-03-13 10:33:03,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0	dst=null	perm=null
2015-03-13 10:33:03,207 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53114, dest: /127.0.0.1:52451, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 57371000
2015-03-13 10:33:03,207 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:03,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_m_000001_0	dst=null	perm=null
2015-03-13 10:33:03,208 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,208 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53113, dest: /127.0.0.1:52444, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 58001000
2015-03-13 10:33:03,208 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,208 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,209 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53110, dest: /127.0.0.1:52447, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 58962000
2015-03-13 10:33:03,209 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:03,209 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:03,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:03,218 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000003
2015-03-13 10:33:03,218 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:33:03,218 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:33:03,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:33:03,218 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000003
2015-03-13 10:33:03,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:03,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000002
2015-03-13 10:33:03,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:03,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:03,220 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:33:03,220 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000002
2015-03-13 10:33:03,221 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:33:03,221 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:33:03,221 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000002, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:03,221 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:03,221 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:03,221 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000002 on node: host: 10.1.1.144:52473 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:33:03,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0/part-m-00001-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,232 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000003 is : 143
2015-03-13 10:33:03,236 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0008_m_000003_0_-1293480310_1
2015-03-13 10:33:03,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000002_0	dst=null	perm=null
2015-03-13 10:33:03,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0	dst=null	perm=null
2015-03-13 10:33:03,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0	dst=null	perm=null
2015-03-13 10:33:03,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0	dst=null	perm=null
2015-03-13 10:33:03,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0	dst=null	perm=null
2015-03-13 10:33:03,244 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:03,245 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003
2015-03-13 10:33:03,245 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003
2015-03-13 10:33:03,245 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003
2015-03-13 10:33:03,245 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000003
2015-03-13 10:33:03,246 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:33:03,246 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:03,246 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000003 from application application_1426267835672_0008
2015-03-13 10:33:03,246 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:03,246 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:03,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0	dst=null	perm=null
2015-03-13 10:33:03,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:03,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:33:03,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0/part-m-00001-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:03,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary/_attempt_1426267835672_0008_m_000003_0	dst=null	perm=null
2015-03-13 10:33:03,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_m_000002_0	dst=null	perm=null
2015-03-13 10:33:03,283 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000004
2015-03-13 10:33:03,283 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:33:03,283 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:33:03,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:03,284 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000004
2015-03-13 10:33:03,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000003
2015-03-13 10:33:03,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:03,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,285 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:03,285 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:33:03,285 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000003
2015-03-13 10:33:03,285 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:33:03,285 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:03,285 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000003, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:03,286 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:03,286 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:33:03,286 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000003 on node: host: 10.1.1.144:52473 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:03,297 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000004 is : 143
2015-03-13 10:33:03,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_m_000003_0	dst=null	perm=null
2015-03-13 10:33:03,311 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000005
2015-03-13 10:33:03,311 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:33:03,312 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:33:03,312 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:03,312 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:03,313 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:33:03,313 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004
2015-03-13 10:33:03,314 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004
2015-03-13 10:33:03,314 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004
2015-03-13 10:33:03,315 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000004
2015-03-13 10:33:03,316 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000005
2015-03-13 10:33:03,332 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000005 is : 143
2015-03-13 10:33:03,346 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:33:03,346 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:03,346 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:03,346 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000004 from application application_1426267835672_0008
2015-03-13 10:33:03,346 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:03,346 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:03,347 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:33:03,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005
2015-03-13 10:33:03,347 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:03,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005
2015-03-13 10:33:03,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005
2015-03-13 10:33:03,348 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000005 from application application_1426267835672_0008
2015-03-13 10:33:03,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000005
2015-03-13 10:33:03,348 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:03,349 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:04,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:04,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:04,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000004
2015-03-13 10:33:04,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:04,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000005
2015-03-13 10:33:04,315 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:04,315 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:33:04,315 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000004
2015-03-13 10:33:04,315 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:33:04,316 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:33:04,316 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000004, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:04,316 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:04,316 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:04,316 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000004 on node: host: 10.1.1.144:52473 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:33:04,317 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:04,317 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:33:04,317 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000005
2015-03-13 10:33:04,317 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52473, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:04,317 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:04,317 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000005, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:04,317 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:04,318 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:04,318 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000005 on node: host: 10.1.1.144:52473 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:05,189 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:05,190 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:05,190 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:05,190 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:33:05,190 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0008 container=Container: [ContainerId: container_1426267835672_0008_01_000006, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0008_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:05,191 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:05,191 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:05,522 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:05,534 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:33:05,536 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0008_01_000006 by user soberoi
2015-03-13 10:33:05,537 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:05,537 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0008_01_000006 to application application_1426267835672_0008
2015-03-13 10:33:05,537 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:33:05,537 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0008
2015-03-13 10:33:05,537 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0008
2015-03-13 10:33:05,537 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:05,538 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0008
2015-03-13 10:33:05,538 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:05,565 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:05,565 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:05,653 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006/default_container_executor.sh]
2015-03-13 10:33:05,839 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095
2015-03-13 10:33:05,839 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096
2015-03-13 10:33:05,840 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097
2015-03-13 10:33:06,028 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094
2015-03-13 10:33:06,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:06,195 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:06,195 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:06,283 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096
2015-03-13 10:33:06,283 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097
2015-03-13 10:33:06,284 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095
2015-03-13 10:33:06,284 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094
2015-03-13 10:33:06,457 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096
2015-03-13 10:33:06,457 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097
2015-03-13 10:33:06,457 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095
2015-03-13 10:33:06,457 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094
2015-03-13 10:33:06,528 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:33:07,197 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:07,197 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:08,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,078 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0008_r_000000_0_1777241589_1
2015-03-13 10:33:08,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0	dst=null	perm=null
2015-03-13 10:33:08,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0	dst=null	perm=null
2015-03-13 10:33:08,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/task_1426267835672_0008_r_000000	dst=null	perm=null
2015-03-13 10:33:08,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/_temporary/attempt_1426267835672_0008_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/task_1426267835672_0008_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:08,102 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000006
2015-03-13 10:33:08,102 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:08,102 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:33:08,102 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000006
2015-03-13 10:33:08,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:08,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:08,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,109 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,113 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0008_01_000006 is : 143
2015-03-13 10:33:08,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1	dst=null	perm=null
2015-03-13 10:33:08,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:08,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:08,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/task_1426267835672_0008_r_000000	dst=null	perm=null
2015-03-13 10:33:08,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000	dst=null	perm=null
2015-03-13 10:33:08,123 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:08,124 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006
2015-03-13 10:33:08,124 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006
2015-03-13 10:33:08,124 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006
2015-03-13 10:33:08,124 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000006
2015-03-13 10:33:08,124 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:08,125 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:08,125 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000006 from application application_1426267835672_0008
2015-03-13 10:33:08,125 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:08,125 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:08,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary/1/task_1426267835672_0008_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary	dst=null	perm=null
2015-03-13 10:33:08,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,136 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,139 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,152 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53117, dest: /127.0.0.1:52454, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, duration: 4971091000
2015-03-13 10:33:08,152 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:08,153 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:08,153 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53116, dest: /127.0.0.1:52451, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, duration: 4970801000
2015-03-13 10:33:08,153 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,154 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:08,154 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53115, dest: /127.0.0.1:52444, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, duration: 4972718000
2015-03-13 10:33:08,155 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,156 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:08,157 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,161 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:08,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099 src: /127.0.0.1:53122 dest: /127.0.0.1:52451
2015-03-13 10:33:08,164 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099 src: /127.0.0.1:53123 dest: /127.0.0.1:52444
2015-03-13 10:33:08,165 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099 src: /127.0.0.1:53124 dest: /127.0.0.1:52447
2015-03-13 10:33:08,168 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53124, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, duration: 1322000
2015-03-13 10:33:08,168 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:08,168 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:08,168 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53123, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, duration: 1673000
2015-03-13 10:33:08,169 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,169 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:08,169 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53122, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, duration: 2649000
2015-03-13 10:33:08,169 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,170 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:08,171 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist	dst=null	perm=null
2015-03-13 10:33:08,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:33:08,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist	dst=null	perm=null
2015-03-13 10:33:08,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:33:08,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1.jhist	dst=null	perm=null
2015-03-13 10:33:08,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,188 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53125, bytes: 58230, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098, duration: 211000
2015-03-13 10:33:08,189 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:08,191 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100 src: /127.0.0.1:53126 dest: /127.0.0.1:52444
2015-03-13 10:33:08,192 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100 src: /127.0.0.1:53127 dest: /127.0.0.1:52447
2015-03-13 10:33:08,193 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100 src: /127.0.0.1:53128 dest: /127.0.0.1:52451
2015-03-13 10:33:08,196 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53128, dest: /127.0.0.1:52451, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, duration: 1659000
2015-03-13 10:33:08,196 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:08,197 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,197 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53127, dest: /127.0.0.1:52447, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, duration: 2197000
2015-03-13 10:33:08,197 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,197 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,198 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53126, dest: /127.0.0.1:52444, bytes: 57778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, duration: 3138000
2015-03-13 10:33:08,198 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,198 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,199 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:08,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:33:08,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:08,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:33:08,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008/job_1426267835672_0008_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:08,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:08,209 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53125, bytes: 92066, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741917_1093, duration: 394000
2015-03-13 10:33:08,211 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:08,213 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101 src: /127.0.0.1:53129 dest: /127.0.0.1:52444
2015-03-13 10:33:08,214 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101 src: /127.0.0.1:53130 dest: /127.0.0.1:52454
2015-03-13 10:33:08,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101 src: /127.0.0.1:53131 dest: /127.0.0.1:52451
2015-03-13 10:33:08,220 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53131, dest: /127.0.0.1:52451, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, duration: 1967000
2015-03-13 10:33:08,220 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:08,220 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53130, dest: /127.0.0.1:52454, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, duration: 2382000
2015-03-13 10:33:08,221 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,221 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53129, dest: /127.0.0.1:52444, bytes: 91350, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1353054260_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, duration: 3345000
2015-03-13 10:33:08,222 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:08,222 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:08,223 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1353054260_1
2015-03-13 10:33:08,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:08,239 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from RUNNING to FINISHING
2015-03-13 10:33:08,239 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0008
2015-03-13 10:33:08,239 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from RUNNING to REMOVING
2015-03-13 10:33:08,239 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0008
2015-03-13 10:33:08,239 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from REMOVING to FINISHING
2015-03-13 10:33:09,105 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:09,105 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:09,106 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000006
2015-03-13 10:33:09,106 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:09,106 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:33:09,107 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000006
2015-03-13 10:33:09,107 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:09,107 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:09,107 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000006, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:09,108 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:09,108 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:09,108 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000006 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:09,245 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741913_1089 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:33:09,245 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741914_1090 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:33:09,245 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741915_1091 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 
2015-03-13 10:33:09,245 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741916_1092 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52444 
2015-03-13 10:33:09,245 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741922_1098 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454 
2015-03-13 10:33:09,245 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741917_1093 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444 
2015-03-13 10:33:09,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0008	dst=null	perm=null
2015-03-13 10:33:09,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:09,287 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary
2015-03-13 10:33:09,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/_temporary	dst=null	perm=null
2015-03-13 10:33:09,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,288 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary
2015-03-13 10:33:09,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:09,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:09,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,291 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary
2015-03-13 10:33:09,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:09,298 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:09,299 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:09,299 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:09,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:09,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:09,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:09,302 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:09,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000	dst=null	perm=null
2015-03-13 10:33:09,310 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:09,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:09,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:09,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,315 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:33:09,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:33:09,319 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53133, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 168000
2015-03-13 10:33:09,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:33:09,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 190000
2015-03-13 10:33:09,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:33:09,323 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 168000
2015-03-13 10:33:09,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:33:09,326 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53135, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 171000
2015-03-13 10:33:09,326 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/seq/tap
2015-03-13 10:33:09,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:09,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:09,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:09,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap	dst=null	perm=null
2015-03-13 10:33:09,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000	dst=null	perm=null
2015-03-13 10:33:09,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/tap/part-00000	dst=null	perm=null
2015-03-13 10:33:09,330 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/seq/trap
2015-03-13 10:33:09,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap	dst=null	perm=null
2015-03-13 10:33:09,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:33:09,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:33:09,335 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53136, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741918_1094, duration: 188000
2015-03-13 10:33:09,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:33:09,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:33:09,338 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53136, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741919_1095, duration: 179000
2015-03-13 10:33:09,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:33:09,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:33:09,341 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53135, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741920_1096, duration: 167000
2015-03-13 10:33:09,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:33:09,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/seq/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:33:09,343 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53135, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741921_1097, duration: 161000
2015-03-13 10:33:09,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:09,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:09,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,347 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt. BP-1641873285-10.1.1.144-1426267833098 blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:09,348 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102 src: /127.0.0.1:53137 dest: /127.0.0.1:52454
2015-03-13 10:33:09,350 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102 src: /127.0.0.1:53138 dest: /127.0.0.1:52444
2015-03-13 10:33:09,351 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102 src: /127.0.0.1:53139 dest: /127.0.0.1:52447
2015-03-13 10:33:09,353 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53139, dest: /127.0.0.1:52447, bytes: 5, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 1103000
2015-03-13 10:33:09,353 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,353 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:09,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53138, dest: /127.0.0.1:52444, bytes: 5, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 1484000
2015-03-13 10:33:09,354 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,354 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:09,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53137, dest: /127.0.0.1:52454, bytes: 5, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 2146000
2015-03-13 10:33:09,354 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,355 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:09,356 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,368 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:09,370 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:33:09,371 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:33:09,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:09,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:09,384 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [] starting
2015-03-13 10:33:09,384 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  source: Hfs["TextDelimited[['id', 'name' | int, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt"]
2015-03-13 10:33:09,384 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  sink: Hfs["TextDelimited[['id', 'name' | int, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation"]
2015-03-13 10:33:09,385 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  parallel execution is enabled: true
2015-03-13 10:33:09,385 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  starting jobs: 1
2015-03-13 10:33:09,385 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  allocating threads: 1
2015-03-13 10:33:09,386 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] starting step: (1/1) ...tform/testTrapNoOperation
2015-03-13 10:33:09,395 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:09,403 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:09,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:09,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:09,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:09,408 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 9
2015-03-13 10:33:09,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009	dst=null	perm=null
2015-03-13 10:33:09,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:33:09,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:33:09,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:09,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,415 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:09,416 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53141 dest: /127.0.0.1:52447
2015-03-13 10:33:09,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53142 dest: /127.0.0.1:52451
2015-03-13 10:33:09,419 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53143 dest: /127.0.0.1:52444
2015-03-13 10:33:09,423 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53143, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 1936000
2015-03-13 10:33:09,423 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,424 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53142, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 2565000
2015-03-13 10:33:09,424 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,424 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53141, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 3690000
2015-03-13 10:33:09,425 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,426 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,427 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,428 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar
2015-03-13 10:33:09,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:09,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:09,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:09,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:09,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:33:09,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:33:09,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:33:09,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:33:09,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:33:09,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:09,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:09,439 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:09,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:09,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,443 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split
2015-03-13 10:33:09,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:09,444 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:09,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104 src: /127.0.0.1:53144 dest: /127.0.0.1:52454
2015-03-13 10:33:09,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104 src: /127.0.0.1:53145 dest: /127.0.0.1:52451
2015-03-13 10:33:09,448 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104 src: /127.0.0.1:53146 dest: /127.0.0.1:52447
2015-03-13 10:33:09,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104 src: /127.0.0.1:53147 dest: /127.0.0.1:52444
2015-03-13 10:33:09,451 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53147, dest: /127.0.0.1:52444, bytes: 1867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 1464000
2015-03-13 10:33:09,451 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,452 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,452 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53146, dest: /127.0.0.1:52447, bytes: 1867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 1812000
2015-03-13 10:33:09,452 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,453 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,453 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53145, dest: /127.0.0.1:52451, bytes: 1867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 2733000
2015-03-13 10:33:09,453 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,453 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,453 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53144, dest: /127.0.0.1:52454, bytes: 1867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 3261000
2015-03-13 10:33:09,454 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,454 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:09,456 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,460 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:09,461 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105 src: /127.0.0.1:53148 dest: /127.0.0.1:52444
2015-03-13 10:33:09,462 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105 src: /127.0.0.1:53149 dest: /127.0.0.1:52447
2015-03-13 10:33:09,464 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105 src: /127.0.0.1:53150 dest: /127.0.0.1:52451
2015-03-13 10:33:09,466 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53150, dest: /127.0.0.1:52451, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 1162000
2015-03-13 10:33:09,466 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,467 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:09,467 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53149, dest: /127.0.0.1:52447, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 1695000
2015-03-13 10:33:09,467 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,468 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:09,468 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53148, dest: /127.0.0.1:52444, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 2914000
2015-03-13 10:33:09,468 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,470 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:09,471 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,471 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:33:09,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:09,476 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:09,477 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:09,477 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:09,507 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:09,508 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106 src: /127.0.0.1:53151 dest: /127.0.0.1:52444
2015-03-13 10:33:09,510 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106 src: /127.0.0.1:53152 dest: /127.0.0.1:52447
2015-03-13 10:33:09,511 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106 src: /127.0.0.1:53153 dest: /127.0.0.1:52454
2015-03-13 10:33:09,514 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53153, dest: /127.0.0.1:52454, bytes: 96639, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 1397000
2015-03-13 10:33:09,514 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:09,515 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:09,515 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53152, dest: /127.0.0.1:52447, bytes: 96639, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 2046000
2015-03-13 10:33:09,515 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,515 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:09,516 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53151, dest: /127.0.0.1:52444, bytes: 96639, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 2955000
2015-03-13 10:33:09,516 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:09,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:09,522 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:09,522 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0009
2015-03-13 10:33:09,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009	dst=null	perm=null
2015-03-13 10:33:09,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:09,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:09,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:09,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:09,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:09,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:09,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:09,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:09,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:09,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:09,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:09,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:09,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:09,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:09,538 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 9 submitted by user soberoi
2015-03-13 10:33:09,538 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0009
2015-03-13 10:33:09,538 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0009
2015-03-13 10:33:09,538 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0009
2015-03-13 10:33:09,538 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from NEW to NEW_SAVING
2015-03-13 10:33:09,539 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:33:09,539 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0009_000001
2015-03-13 10:33:09,539 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from NEW to SUBMITTED
2015-03-13 10:33:09,539 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0009 from user: soberoi activated in queue: default
2015-03-13 10:33:09,539 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0009 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:33:09,539 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0009 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:33:09,539 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0009 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:09,539 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0009_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:33:09,540 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:33:09,541 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from SUBMITTED to ACCEPTED
2015-03-13 10:33:09,542 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0009/
2015-03-13 10:33:09,542 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] submitted hadoop job: job_1426267835672_0009
2015-03-13 10:33:09,542 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0009/
2015-03-13 10:33:10,001 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741927_1103 to datanode(s) 127.0.0.1:52454
2015-03-13 10:33:10,001 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741913_1089, blk_1073741914_1090]
2015-03-13 10:33:10,001 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741922_1098, blk_1073741913_1089, blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093]
2015-03-13 10:33:10,107 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:10,108 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:10,109 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000001
2015-03-13 10:33:10,109 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:33:10,109 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0009_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:10,109 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:33:10,109 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:10,110 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:10,110 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0009 AttemptId: appattempt_1426267835672_0009_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:33:10,111 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:33:10,111 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0009_000001
2015-03-13 10:33:10,111 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:33:10,111 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0009_000001
2015-03-13 10:33:10,112 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0009_000001
2015-03-13 10:33:10,112 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0009_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:33:10,117 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:10,121 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000001 by user soberoi
2015-03-13 10:33:10,121 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0009
2015-03-13 10:33:10,121 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000001
2015-03-13 10:33:10,121 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from NEW to INITING
2015-03-13 10:33:10,121 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000001 to application application_1426267835672_0009
2015-03-13 10:33:10,121 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0009_000001
2015-03-13 10:33:10,122 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from INITING to RUNNING
2015-03-13 10:33:10,122 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:33:10,122 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:33:10,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:10,122 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:10,122 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:33:10,122 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:33:10,122 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:10,123 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0009_01_000001
2015-03-13 10:33:10,131 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0009_01_000001.tokens. Credentials list: 
2015-03-13 10:33:10,147 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:10,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0009_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001.tokens
2015-03-13 10:33:10,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:10,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:10,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:10,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:10,297 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1430556630_4539, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 498000
2015-03-13 10:33:10,317 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:10,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:10,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:10,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:10,343 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1430556630_4539, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 199000
2015-03-13 10:33:10,355 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:10,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:10,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:10,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:10,379 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53134, bytes: 1883, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1430556630_4539, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 179000
2015-03-13 10:33:10,392 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:10,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:10,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:10,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:10,418 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53157, bytes: 97395, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1430556630_4539, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 222000
2015-03-13 10:33:10,431 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:10,431 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:10,456 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:10,456 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:10,526 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001/default_container_executor.sh]
2015-03-13 10:33:10,634 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913 for deletion
2015-03-13 10:33:10,634 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914 for deletion
2015-03-13 10:33:10,634 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 to 127.0.0.1:52454 
2015-03-13 10:33:10,634 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913
2015-03-13 10:33:10,635 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914
2015-03-13 10:33:10,636 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53158 dest: /127.0.0.1:52454
2015-03-13 10:33:10,636 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 (numBytes=254067) to /127.0.0.1:52454
2015-03-13 10:33:10,637 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103 src: /127.0.0.1:53158 dest: /127.0.0.1:52454 of size 254067
2015-03-13 10:33:10,638 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741927_1103 size 254067
2015-03-13 10:33:11,014 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922 for deletion
2015-03-13 10:33:11,015 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913 for deletion
2015-03-13 10:33:11,015 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914 for deletion
2015-03-13 10:33:11,015 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922
2015-03-13 10:33:11,015 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915 for deletion
2015-03-13 10:33:11,015 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916 for deletion
2015-03-13 10:33:11,015 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917 for deletion
2015-03-13 10:33:11,015 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914
2015-03-13 10:33:11,015 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913
2015-03-13 10:33:11,016 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916
2015-03-13 10:33:11,016 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915
2015-03-13 10:33:11,016 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917
2015-03-13 10:33:11,032 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104
2015-03-13 10:33:11,033 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106
2015-03-13 10:33:11,034 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101
2015-03-13 10:33:11,034 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102
2015-03-13 10:33:11,047 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103
2015-03-13 10:33:11,048 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104
2015-03-13 10:33:11,048 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102
2015-03-13 10:33:11,049 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099
2015-03-13 10:33:11,049 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100
2015-03-13 10:33:11,050 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105
2015-03-13 10:33:11,051 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106
2015-03-13 10:33:11,113 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:11,114 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:11,114 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:11,237 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103
2015-03-13 10:33:11,465 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098
2015-03-13 10:33:11,466 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100
2015-03-13 10:33:11,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106
2015-03-13 10:33:11,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105
2015-03-13 10:33:11,497 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103
2015-03-13 10:33:11,498 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104
2015-03-13 10:33:11,499 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741924_1100
2015-03-13 10:33:11,499 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105
2015-03-13 10:33:11,500 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099
2015-03-13 10:33:11,500 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741922_1098
2015-03-13 10:33:11,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101
2015-03-13 10:33:11,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099
2015-03-13 10:33:11,669 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104
2015-03-13 10:33:11,692 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741925_1101
2015-03-13 10:33:11,868 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103
2015-03-13 10:33:11,869 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102
2015-03-13 10:33:12,117 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:12,117 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:12,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:12,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:33:12,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:33:12,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:33:12,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009	dst=null	perm=null
2015-03-13 10:33:12,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:33:12,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:33:12,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:12,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:12,559 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53160, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741929_1105, duration: 162000
2015-03-13 10:33:13,007 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741922_1098, blk_1073741913_1089, blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093]
2015-03-13 10:33:13,007 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741922_1098, blk_1073741913_1089, blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093]
2015-03-13 10:33:13,121 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:13,121 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:13,323 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:13,324 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0009_000001
2015-03-13 10:33:13,324 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0009	APPATTEMPTID=appattempt_1426267835672_0009_000001
2015-03-13 10:33:13,324 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:33:13,324 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from ACCEPTED to RUNNING
2015-03-13 10:33:13,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:13,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:13,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:13,551 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:13,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107 src: /127.0.0.1:53166 dest: /127.0.0.1:52444
2015-03-13 10:33:13,589 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107 src: /127.0.0.1:53167 dest: /127.0.0.1:52447
2015-03-13 10:33:13,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107 src: /127.0.0.1:53168 dest: /127.0.0.1:52454
2015-03-13 10:33:13,598 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53168, dest: /127.0.0.1:52454, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, duration: 5695000
2015-03-13 10:33:13,598 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:13,598 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:13,599 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53167, dest: /127.0.0.1:52447, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, duration: 6398000
2015-03-13 10:33:13,599 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:13,599 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:13,599 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53166, dest: /127.0.0.1:52444, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, duration: 7299000
2015-03-13 10:33:13,600 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:13,600 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:13,603 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:13,639 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922 for deletion
2015-03-13 10:33:13,639 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913 for deletion
2015-03-13 10:33:13,639 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914 for deletion
2015-03-13 10:33:13,639 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922
2015-03-13 10:33:13,639 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915 for deletion
2015-03-13 10:33:13,639 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913
2015-03-13 10:33:13,639 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916 for deletion
2015-03-13 10:33:13,639 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914
2015-03-13 10:33:13,640 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915
2015-03-13 10:33:13,640 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917 for deletion
2015-03-13 10:33:13,640 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916
2015-03-13 10:33:13,640 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917
2015-03-13 10:33:13,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922 for deletion
2015-03-13 10:33:13,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913 for deletion
2015-03-13 10:33:13,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914 for deletion
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915 for deletion
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741913_1089 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741913
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916 for deletion
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741922_1098 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741922
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917 for deletion
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741915
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741914
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741917
2015-03-13 10:33:13,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741916
2015-03-13 10:33:14,122 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:14,122 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:14,381 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0008_01_000001 succeeded 
2015-03-13 10:33:14,381 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:33:14,381 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0008_01_000001
2015-03-13 10:33:14,388 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0008_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:33:14,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008/container_1426267835672_0008_01_000001
2015-03-13 10:33:14,389 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0008_01_000001 from application application_1426267835672_0008
2015-03-13 10:33:14,390 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:14,390 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0008
2015-03-13 10:33:15,124 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:33:15,124 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0008_01_000001
2015-03-13 10:33:15,124 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:15,125 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0008_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:15,125 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0008_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:33:15,125 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0008_000001
2015-03-13 10:33:15,125 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0008	CONTAINERID=container_1426267835672_0008_01_000001
2015-03-13 10:33:15,125 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0008_000001 State change from FINISHING to FINISHED
2015-03-13 10:33:15,125 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:15,125 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0008 State change from FINISHING to FINISHED
2015-03-13 10:33:15,126 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:15,126 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0008_000001
2015-03-13 10:33:15,126 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0008_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,126 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0008
2015-03-13 10:33:15,126 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,126 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0008,name=[F9B537FAC95645ECA39BE2CD77067409/E03532BB4F26472AB8B07F9C2D7BA44F] trap test/(1/1) ...-mr1/trapplatform/seq/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0008/jobhistory/job/job_1426267835672_0008,appMasterHost=Edinburgh.local,startTime=1426267969680,finishTime=1426267988239,finalStatus=SUCCEEDED
2015-03-13 10:33:15,126 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:33:15,126 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0008_000001 released container container_1426267835672_0008_01_000001 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:15,127 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,127 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:15,127 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:33:15,127 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0009_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,127 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:33:15,128 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,128 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,128 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:15,128 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:33:15,129 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0009_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,129 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:33:15,129 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,129 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0008_000001 is done. finalState=FINISHED
2015-03-13 10:33:15,129 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0008_000001 (auth:SIMPLE)
2015-03-13 10:33:15,129 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0008 requests cleared
2015-03-13 10:33:15,129 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0008 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:33:15,129 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0008 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:33:15,131 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0008_01_000001
2015-03-13 10:33:15,297 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,298 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:15,298 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:33:15,298 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000004, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0009_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,298 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:15,298 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,299 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,299 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:15,299 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:33:15,299 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000005, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0009_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,300 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:33:15,300 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,300 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:15,300 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:15,300 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:33:15,300 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0009 container=Container: [ContainerId: container_1426267835672_0009_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0009_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,300 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:33:15,300 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:15,340 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:15,340 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:15,340 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0008
2015-03-13 10:33:15,341 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:15,341 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:15,341 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0008, with delay of 10800 seconds
2015-03-13 10:33:15,341 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:15,342 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:15,359 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,359 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,359 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,359 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,359 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:15,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:15,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:15,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:15,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:15,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:15,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:15,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:15,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:15,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:15,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:15,493 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:15,493 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:15,496 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000002 by user soberoi
2015-03-13 10:33:15,496 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000003 by user soberoi
2015-03-13 10:33:15,497 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000004 by user soberoi
2015-03-13 10:33:15,497 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000005 by user soberoi
2015-03-13 10:33:15,497 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0009
2015-03-13 10:33:15,497 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0009_01_000006 by user soberoi
2015-03-13 10:33:15,497 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000005 to application application_1426267835672_0009
2015-03-13 10:33:15,497 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:15,496 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:15,497 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from NEW to INITING
2015-03-13 10:33:15,497 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000004 to application application_1426267835672_0009
2015-03-13 10:33:15,498 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000006 to application application_1426267835672_0009
2015-03-13 10:33:15,497 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:15,498 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from INITING to RUNNING
2015-03-13 10:33:15,497 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:15,498 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,498 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,497 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000002 to application application_1426267835672_0009
2015-03-13 10:33:15,499 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,499 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,499 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,499 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,499 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,499 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:15,499 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:15,499 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,499 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,499 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,497 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:15,500 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,499 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0009_01_000003 to application application_1426267835672_0009
2015-03-13 10:33:15,500 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,500 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,500 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,500 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,500 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0009_01_000006
2015-03-13 10:33:15,500 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,501 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0009_01_000005
2015-03-13 10:33:15,501 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:33:15,501 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,502 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,502 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,502 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,502 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,502 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0009
2015-03-13 10:33:15,502 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:15,502 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0009
2015-03-13 10:33:15,502 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,503 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,506 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0009_01_000004
2015-03-13 10:33:15,525 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426267835672_0009_01_000005.tokens. Credentials list: 
2015-03-13 10:33:15,525 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0009_01_000004.tokens. Credentials list: 
2015-03-13 10:33:15,526 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0009_01_000006.tokens. Credentials list: 
2015-03-13 10:33:15,544 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,545 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:15,545 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,545 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:15,550 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:15,644 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002/default_container_executor.sh]
2015-03-13 10:33:15,648 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003/default_container_executor.sh]
2015-03-13 10:33:15,649 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426267835672_0009_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005.tokens
2015-03-13 10:33:15,649 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:15,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:15,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:15,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar	dst=null	perm=null
2015-03-13 10:33:15,753 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53174, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-82095608_4693, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741927_1103, duration: 450000
2015-03-13 10:33:15,780 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:15,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:15,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:15,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml	dst=null	perm=null
2015-03-13 10:33:15,813 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53174, bytes: 97395, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-82095608_4693, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741930_1106, duration: 296000
2015-03-13 10:33:15,832 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:15,832 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,832 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,833 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:15,893 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,893 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,893 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:15,893 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:15,893 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:15,893 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:16,014 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004/default_container_executor.sh]
2015-03-13 10:33:16,015 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005/default_container_executor.sh]
2015-03-13 10:33:16,031 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006/default_container_executor.sh]
2015-03-13 10:33:16,061 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107
2015-03-13 10:33:16,129 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,129 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,129 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,130 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:16,130 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,130 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,130 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:16,130 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:16,130 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:16,131 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0008
2015-03-13 10:33:16,131 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:16,131 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0008, with delay of 10800 seconds
2015-03-13 10:33:16,131 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0008
2015-03-13 10:33:16,243 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107
2015-03-13 10:33:16,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:16,299 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,299 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,299 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:16,378 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:33:16,863 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:16,874 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107
2015-03-13 10:33:16,993 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0009_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006.tokens
2015-03-13 10:33:16,993 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:17,093 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:17,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,135 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0009_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004.tokens
2015-03-13 10:33:17,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:17,301 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,301 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:17,302 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,141 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:18,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,312 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:19,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:20,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,148 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,149 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,149 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:21,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,318 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,318 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:22,319 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,158 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,159 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,159 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:23,321 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,322 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,322 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:23,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:23,521 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53184, bytes: 1883, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000001_0_-1634886875_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 205000
2015-03-13 10:33:23,649 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53185, bytes: 1883, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 148000
2015-03-13 10:33:23,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:23,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:23,731 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53187, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000001_0_-1634886875_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 165000
2015-03-13 10:33:23,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:23,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:23,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job.split	dst=null	perm=null
2015-03-13 10:33:23,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:23,853 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53190, bytes: 1367, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000002_0_605197829_1, offset: 512, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 185000
2015-03-13 10:33:23,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:23,919 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53191, bytes: 851, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000004_0_-1928763944_1, offset: 1024, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 149000
2015-03-13 10:33:23,957 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53192, bytes: 851, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741928_1104, duration: 161000
2015-03-13 10:33:23,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:23,994 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53190, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000002_0_605197829_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 160000
2015-03-13 10:33:24,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,051 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_1426267835672_0009_m_000001_0_-1634886875_1
2015-03-13 10:33:24,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:24,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0	dst=null	perm=null
2015-03-13 10:33:24,063 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53193, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000004_0_-1928763944_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 155000
2015-03-13 10:33:24,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0	dst=null	perm=null
2015-03-13 10:33:24,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000001	dst=null	perm=null
2015-03-13 10:33:24,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/delimited-problematic.txt	dst=null	perm=null
2015-03-13 10:33:24,091 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53192, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 166000
2015-03-13 10:33:24,098 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000003
2015-03-13 10:33:24,098 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:24,098 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,099 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000003
2015-03-13 10:33:24,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,111 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000003 is : 143
2015-03-13 10:33:24,113 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:24,114 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108 src: /127.0.0.1:53194 dest: /127.0.0.1:52451
2015-03-13 10:33:24,117 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108 src: /127.0.0.1:53195 dest: /127.0.0.1:52444
2015-03-13 10:33:24,118 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108 src: /127.0.0.1:53196 dest: /127.0.0.1:52447
2015-03-13 10:33:24,125 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist for DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,126 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,127 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003
2015-03-13 10:33:24,127 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003
2015-03-13 10:33:24,127 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003
2015-03-13 10:33:24,127 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:24,128 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000003
2015-03-13 10:33:24,128 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,128 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000003 from application application_1426267835672_0009
2015-03-13 10:33:24,128 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,128 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,152 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53197, bytes: 9, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741926_1102, duration: 3739000
2015-03-13 10:33:24,186 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:24,232 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109 src: /127.0.0.1:53198 dest: /127.0.0.1:52447
2015-03-13 10:33:24,234 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109 src: /127.0.0.1:53199 dest: /127.0.0.1:52454
2015-03-13 10:33:24,236 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109 src: /127.0.0.1:53200 dest: /127.0.0.1:52451
2015-03-13 10:33:24,244 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53200, dest: /127.0.0.1:52451, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, duration: 6095000
2015-03-13 10:33:24,244 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,244 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,245 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53199, dest: /127.0.0.1:52454, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, duration: 6779000
2015-03-13 10:33:24,245 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,246 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53198, dest: /127.0.0.1:52447, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, duration: 8425000
2015-03-13 10:33:24,246 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,246 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,247 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,251 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0009_m_000000_0_-355254458_1
2015-03-13 10:33:24,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0	dst=null	perm=null
2015-03-13 10:33:24,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0	dst=null	perm=null
2015-03-13 10:33:24,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000000	dst=null	perm=null
2015-03-13 10:33:24,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,289 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000002
2015-03-13 10:33:24,289 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:24,289 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,289 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000002
2015-03-13 10:33:24,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,290 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,290 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:24,290 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000003
2015-03-13 10:33:24,290 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:24,291 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:33:24,291 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000003
2015-03-13 10:33:24,291 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:33:24,291 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:33:24,291 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,292 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,292 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:33:24,292 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000003 on node: host: 10.1.1.144:52481 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:33:24,302 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000002 is : 143
2015-03-13 10:33:24,315 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002
2015-03-13 10:33:24,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002
2015-03-13 10:33:24,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002
2015-03-13 10:33:24,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000002
2015-03-13 10:33:24,317 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:24,317 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,317 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000002 from application application_1426267835672_0009
2015-03-13 10:33:24,318 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,318 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,381 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_1426267835672_0009_m_000002_0_605197829_1
2015-03-13 10:33:24,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0	dst=null	perm=null
2015-03-13 10:33:24,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0	dst=null	perm=null
2015-03-13 10:33:24,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000002	dst=null	perm=null
2015-03-13 10:33:24,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,420 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0/part-00004 is closed by DFSClient_attempt_1426267835672_0009_m_000004_0_-1928763944_1
2015-03-13 10:33:24,425 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000004
2015-03-13 10:33:24,425 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:24,425 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,425 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000004
2015-03-13 10:33:24,425 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,426 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,426 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,439 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000004 is : 143
2015-03-13 10:33:24,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0	dst=null	perm=null
2015-03-13 10:33:24,450 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,451 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000004
2015-03-13 10:33:24,451 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,452 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000004 from application application_1426267835672_0009
2015-03-13 10:33:24,452 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,452 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0	dst=null	perm=null
2015-03-13 10:33:24,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000004	dst=null	perm=null
2015-03-13 10:33:24,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary	dst=null	perm=null
2015-03-13 10:33:24,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,471 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000006
2015-03-13 10:33:24,471 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:24,471 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,471 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000006
2015-03-13 10:33:24,472 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:24,472 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000004
2015-03-13 10:33:24,472 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:24,472 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,473 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:24,473 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:33:24,473 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000004
2015-03-13 10:33:24,473 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:33:24,473 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:33:24,474 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000004, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,474 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,474 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:24,474 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000004 on node: host: 10.1.1.144:52477 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:24,483 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000006 is : 143
2015-03-13 10:33:24,493 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:24,494 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006
2015-03-13 10:33:24,495 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006
2015-03-13 10:33:24,495 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006
2015-03-13 10:33:24,495 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000006
2015-03-13 10:33:24,497 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:24,497 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,497 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000006 from application application_1426267835672_0009
2015-03-13 10:33:24,497 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,497 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,530 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110 src: /127.0.0.1:53201 dest: /127.0.0.1:52451
2015-03-13 10:33:24,532 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110 src: /127.0.0.1:53202 dest: /127.0.0.1:52454
2015-03-13 10:33:24,533 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110 src: /127.0.0.1:53203 dest: /127.0.0.1:52444
2015-03-13 10:33:24,541 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53203, dest: /127.0.0.1:52444, bytes: 2, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 6229000
2015-03-13 10:33:24,541 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,541 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:24,541 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53202, dest: /127.0.0.1:52454, bytes: 2, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 6855000
2015-03-13 10:33:24,542 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,542 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:24,542 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53201, dest: /127.0.0.1:52451, bytes: 2, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 7857000
2015-03-13 10:33:24,543 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,543 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:24,547 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1
2015-03-13 10:33:24,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:33:24,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:33:24,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:33:24,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:33:24,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:33:24,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:33:24,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0/part-m-00001-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/part-m-00001-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary/_attempt_1426267835672_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:33:24,583 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_1426267835672_0009_m_000003_0_120536792_1
2015-03-13 10:33:24,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:33:24,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:33:24,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000003	dst=null	perm=null
2015-03-13 10:33:24,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/_temporary/attempt_1426267835672_0009_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:24,606 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000005
2015-03-13 10:33:24,606 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:24,606 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:33:24,606 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000005
2015-03-13 10:33:24,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:24,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:24,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000006
2015-03-13 10:33:24,607 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:24,608 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:33:24,608 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000006
2015-03-13 10:33:24,608 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:33:24,608 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:24,609 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,609 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:24,609 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:33:24,609 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000006 on node: host: 10.1.1.144:52477 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:33:24,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,613 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1	dst=null	perm=null
2015-03-13 10:33:24,618 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0009_01_000005 is : 143
2015-03-13 10:33:24,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000000	dst=null	perm=null
2015-03-13 10:33:24,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00000	dst=null	perm=null
2015-03-13 10:33:24,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,632 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:24,632 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005
2015-03-13 10:33:24,632 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005
2015-03-13 10:33:24,633 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:24,633 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:24,633 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000005 from application application_1426267835672_0009
2015-03-13 10:33:24,633 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:24,633 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:24,633 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005
2015-03-13 10:33:24,633 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000005
2015-03-13 10:33:24,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000001	dst=null	perm=null
2015-03-13 10:33:24,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00001	dst=null	perm=null
2015-03-13 10:33:24,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000002	dst=null	perm=null
2015-03-13 10:33:24,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00002	dst=null	perm=null
2015-03-13 10:33:24,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000003	dst=null	perm=null
2015-03-13 10:33:24,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00003	dst=null	perm=null
2015-03-13 10:33:24,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:24,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000004	dst=null	perm=null
2015-03-13 10:33:24,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00004	dst=null	perm=null
2015-03-13 10:33:24,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary/1/task_1426267835672_0009_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary	dst=null	perm=null
2015-03-13 10:33:24,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,673 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,677 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,691 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53196, dest: /127.0.0.1:52447, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, duration: 571310000
2015-03-13 10:33:24,691 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,692 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,693 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53195, dest: /127.0.0.1:52444, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, duration: 572069000
2015-03-13 10:33:24,693 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,695 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,695 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53194, dest: /127.0.0.1:52451, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, duration: 574234000
2015-03-13 10:33:24,695 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,697 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,701 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,709 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:24,711 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111 src: /127.0.0.1:53204 dest: /127.0.0.1:52454
2015-03-13 10:33:24,713 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111 src: /127.0.0.1:53205 dest: /127.0.0.1:52447
2015-03-13 10:33:24,714 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111 src: /127.0.0.1:53206 dest: /127.0.0.1:52451
2015-03-13 10:33:24,718 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53206, dest: /127.0.0.1:52451, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, duration: 2534000
2015-03-13 10:33:24,719 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,719 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,719 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53205, dest: /127.0.0.1:52447, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, duration: 3270000
2015-03-13 10:33:24,719 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,720 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53204, dest: /127.0.0.1:52454, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, duration: 4135000
2015-03-13 10:33:24,720 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,721 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:24,722 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist	dst=null	perm=null
2015-03-13 10:33:24,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:33:24,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist	dst=null	perm=null
2015-03-13 10:33:24,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:33:24,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1.jhist	dst=null	perm=null
2015-03-13 10:33:24,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,744 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53207, bytes: 51839, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108, duration: 202000
2015-03-13 10:33:24,746 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:24,748 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112 src: /127.0.0.1:53208 dest: /127.0.0.1:52451
2015-03-13 10:33:24,749 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112 src: /127.0.0.1:53209 dest: /127.0.0.1:52447
2015-03-13 10:33:24,750 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112 src: /127.0.0.1:53210 dest: /127.0.0.1:52454
2015-03-13 10:33:24,753 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53210, dest: /127.0.0.1:52454, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, duration: 1420000
2015-03-13 10:33:24,753 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,754 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:24,754 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53209, dest: /127.0.0.1:52447, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, duration: 1882000
2015-03-13 10:33:24,754 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,754 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:24,755 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53208, dest: /127.0.0.1:52451, bytes: 51435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, duration: 2787000
2015-03-13 10:33:24,755 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,755 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:24,757 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:24,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:33:24,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:24,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:33:24,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009/job_1426267835672_0009_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:24,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:24,767 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53207, bytes: 90119, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741931_1107, duration: 323000
2015-03-13 10:33:24,769 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:24,771 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113 src: /127.0.0.1:53211 dest: /127.0.0.1:52454
2015-03-13 10:33:24,773 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113 src: /127.0.0.1:53212 dest: /127.0.0.1:52444
2015-03-13 10:33:24,774 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113 src: /127.0.0.1:53213 dest: /127.0.0.1:52447
2015-03-13 10:33:24,778 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53213, dest: /127.0.0.1:52447, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, duration: 2069000
2015-03-13 10:33:24,778 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:24,778 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,778 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53212, dest: /127.0.0.1:52444, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, duration: 2794000
2015-03-13 10:33:24,779 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,779 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,779 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53211, dest: /127.0.0.1:52454, bytes: 89419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-114262917_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, duration: 3539000
2015-03-13 10:33:24,779 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:24,780 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:24,781 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-114262917_1
2015-03-13 10:33:24,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:24,795 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from RUNNING to FINISHING
2015-03-13 10:33:24,795 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0009
2015-03-13 10:33:24,796 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from RUNNING to REMOVING
2015-03-13 10:33:24,796 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0009
2015-03-13 10:33:24,796 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from REMOVING to FINISHING
2015-03-13 10:33:25,296 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:25,296 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:25,296 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000002
2015-03-13 10:33:25,297 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:25,297 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:33:25,297 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000002
2015-03-13 10:33:25,297 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:25,298 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:33:25,298 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:25,299 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:25,299 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:25,299 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000002 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:25,613 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:25,613 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000005
2015-03-13 10:33:25,614 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:25,614 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:33:25,614 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000005
2015-03-13 10:33:25,614 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:25,614 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:25,615 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000005, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:25,615 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:25,615 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:25,615 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000005 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:25,806 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741927_1103 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:33:25,806 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741928_1104 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52444 
2015-03-13 10:33:25,807 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741929_1105 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52451 
2015-03-13 10:33:25,807 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741930_1106 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:33:25,807 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741932_1108 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:33:25,807 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741931_1107 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:33:25,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0009	dst=null	perm=null
2015-03-13 10:33:25,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:25,844 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary
2015-03-13 10:33:25,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/_temporary	dst=null	perm=null
2015-03-13 10:33:25,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:25,845 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary
2015-03-13 10:33:25,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary	dst=null	perm=null
2015-03-13 10:33:25,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/_temporary	dst=null	perm=null
2015-03-13 10:33:25,855 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:25,855 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:25,855 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:25,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:25,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:25,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:25,859 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:25,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:33:25,861 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53215, bytes: 6, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 175000
2015-03-13 10:33:25,862 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/testTrapNoOperation_trap
2015-03-13 10:33:25,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:25,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:25,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:25,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap	dst=null	perm=null
2015-03-13 10:33:25,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:33:25,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation_trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:33:25,867 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 6, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110, duration: 183000
2015-03-13 10:33:25,867 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/testTrapNoOperation
2015-03-13 10:33:25,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:25,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:25,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:25,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation	dst=null	perm=null
2015-03-13 10:33:25,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00000	dst=null	perm=null
2015-03-13 10:33:25,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00000	dst=null	perm=null
2015-03-13 10:33:25,872 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109, duration: 138000
2015-03-13 10:33:25,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00001	dst=null	perm=null
2015-03-13 10:33:25,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00001	dst=null	perm=null
2015-03-13 10:33:25,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00002	dst=null	perm=null
2015-03-13 10:33:25,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00002	dst=null	perm=null
2015-03-13 10:33:25,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00003	dst=null	perm=null
2015-03-13 10:33:25,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00003	dst=null	perm=null
2015-03-13 10:33:25,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00004	dst=null	perm=null
2015-03-13 10:33:25,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/testTrapNoOperation/part-00004	dst=null	perm=null
2015-03-13 10:33:25,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:25,891 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:25,892 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:33:25,893 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:33:25,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:25,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:25,904 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:33:25,904 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:33:25,904 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap"]
2015-03-13 10:33:25,905 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:33:25,905 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:33:25,905 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:33:25,906 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...applatform/everystart/tap
2015-03-13 10:33:25,923 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:25,933 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:25,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:25,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:25,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:25,938 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 10
2015-03-13 10:33:25,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010	dst=null	perm=null
2015-03-13 10:33:25,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:33:25,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:33:25,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:25,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,944 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:25,946 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53218 dest: /127.0.0.1:52447
2015-03-13 10:33:25,947 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53219 dest: /127.0.0.1:52444
2015-03-13 10:33:25,948 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53220 dest: /127.0.0.1:52454
2015-03-13 10:33:25,952 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53220, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 2192000
2015-03-13 10:33:25,952 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:25,952 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:25,952 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53219, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 2559000
2015-03-13 10:33:25,953 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,953 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:25,953 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53218, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 3843000
2015-03-13 10:33:25,953 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,954 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:25,955 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:25,956 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar
2015-03-13 10:33:25,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:25,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:25,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:25,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:25,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:33:25,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:33:25,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:33:25,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:33:25,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:33:25,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:25,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:25,964 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:25,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:25,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,970 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split
2015-03-13 10:33:25,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:25,971 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:25,973 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115 src: /127.0.0.1:53221 dest: /127.0.0.1:52451
2015-03-13 10:33:25,974 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115 src: /127.0.0.1:53222 dest: /127.0.0.1:52454
2015-03-13 10:33:25,976 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115 src: /127.0.0.1:53223 dest: /127.0.0.1:52447
2015-03-13 10:33:25,977 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115 src: /127.0.0.1:53224 dest: /127.0.0.1:52444
2015-03-13 10:33:25,980 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53224, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 1532000
2015-03-13 10:33:25,980 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:25,980 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:25,980 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53223, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 2118000
2015-03-13 10:33:25,981 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,981 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:25,981 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53222, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 3010000
2015-03-13 10:33:25,981 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,982 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:25,982 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53221, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 3941000
2015-03-13 10:33:25,982 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,983 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:25,984 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:25,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:25,989 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:25,991 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116 src: /127.0.0.1:53225 dest: /127.0.0.1:52444
2015-03-13 10:33:25,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116 src: /127.0.0.1:53226 dest: /127.0.0.1:52454
2015-03-13 10:33:25,993 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116 src: /127.0.0.1:53227 dest: /127.0.0.1:52451
2015-03-13 10:33:25,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53227, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 1126000
2015-03-13 10:33:25,996 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:25,996 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:25,996 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53226, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 1540000
2015-03-13 10:33:25,996 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,997 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:25,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53225, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 2157000
2015-03-13 10:33:25,997 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:25,998 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:25,999 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:25,999 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:33:26,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:26,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:26,003 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:26,003 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:26,003 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:26,006 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:26,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117 src: /127.0.0.1:53228 dest: /127.0.0.1:52447
2015-03-13 10:33:26,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117 src: /127.0.0.1:53229 dest: /127.0.0.1:52451
2015-03-13 10:33:26,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117 src: /127.0.0.1:53230 dest: /127.0.0.1:52444
2015-03-13 10:33:26,012 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53230, dest: /127.0.0.1:52444, bytes: 98158, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 1493000
2015-03-13 10:33:26,013 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:26,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53229, dest: /127.0.0.1:52451, bytes: 98158, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 1897000
2015-03-13 10:33:26,013 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:26,013 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:26,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53228, dest: /127.0.0.1:52447, bytes: 98158, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 2702000
2015-03-13 10:33:26,014 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:26,014 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:26,015 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:26,016 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:26,016 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0010
2015-03-13 10:33:26,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010	dst=null	perm=null
2015-03-13 10:33:26,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:26,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:26,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:26,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:26,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:26,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:26,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:26,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:26,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:26,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:26,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:26,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:26,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:26,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:26,032 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 10 submitted by user soberoi
2015-03-13 10:33:26,032 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0010
2015-03-13 10:33:26,032 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0010
2015-03-13 10:33:26,032 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0010
2015-03-13 10:33:26,032 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from NEW to NEW_SAVING
2015-03-13 10:33:26,032 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:33:26,033 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0010_000001
2015-03-13 10:33:26,033 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from NEW to SUBMITTED
2015-03-13 10:33:26,033 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0010 from user: soberoi activated in queue: default
2015-03-13 10:33:26,033 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0010 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:33:26,033 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0010 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:33:26,033 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0010 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:26,033 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0010_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:33:26,034 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:33:26,035 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from SUBMITTED to ACCEPTED
2015-03-13 10:33:26,036 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0010/
2015-03-13 10:33:26,036 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0010
2015-03-13 10:33:26,036 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0010/
2015-03-13 10:33:26,070 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113
2015-03-13 10:33:26,071 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108
2015-03-13 10:33:26,071 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111
2015-03-13 10:33:26,072 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112
2015-03-13 10:33:26,072 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109
2015-03-13 10:33:26,073 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117
2015-03-13 10:33:26,073 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115
2015-03-13 10:33:26,247 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110
2015-03-13 10:33:26,248 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113
2015-03-13 10:33:26,248 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112
2015-03-13 10:33:26,249 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111
2015-03-13 10:33:26,249 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115
2015-03-13 10:33:26,249 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116
2015-03-13 10:33:26,249 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109
2015-03-13 10:33:26,297 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:26,298 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:26,298 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000001
2015-03-13 10:33:26,298 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:33:26,298 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0010_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:26,299 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:33:26,299 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:26,299 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:26,300 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0010 AttemptId: appattempt_1426267835672_0010_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ]
2015-03-13 10:33:26,300 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:33:26,300 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0010_000001
2015-03-13 10:33:26,301 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:33:26,301 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0010_000001
2015-03-13 10:33:26,301 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0010_000001
2015-03-13 10:33:26,302 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0010_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:33:26,304 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0010_000001 (auth:SIMPLE)
2015-03-13 10:33:26,305 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000001 by user soberoi
2015-03-13 10:33:26,306 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0010
2015-03-13 10:33:26,306 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000001
2015-03-13 10:33:26,306 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from NEW to INITING
2015-03-13 10:33:26,306 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000001 to application application_1426267835672_0010
2015-03-13 10:33:26,306 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from INITING to RUNNING
2015-03-13 10:33:26,306 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] for AM appattempt_1426267835672_0010_000001
2015-03-13 10:33:26,306 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:33:26,306 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:33:26,306 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:26,307 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:26,307 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:33:26,307 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:33:26,307 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:26,307 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000001
2015-03-13 10:33:26,317 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0010_01_000001.tokens. Credentials list: 
2015-03-13 10:33:26,334 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:26,407 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0010_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001.tokens
2015-03-13 10:33:26,407 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:26,450 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114
2015-03-13 10:33:26,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:26,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:26,471 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114
2015-03-13 10:33:26,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:26,479 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53234, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_954858160_4984, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 484000
2015-03-13 10:33:26,498 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:26,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:26,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:26,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:26,522 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_954858160_4984, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 189000
2015-03-13 10:33:26,535 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:26,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:26,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:26,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:26,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_954858160_4984, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 177000
2015-03-13 10:33:26,571 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:26,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:26,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:26,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:26,595 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53216, bytes: 98926, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_954858160_4984, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 271000
2015-03-13 10:33:26,608 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:26,608 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:26,641 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:26,641 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:26,697 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108
2015-03-13 10:33:26,698 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111
2015-03-13 10:33:26,698 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116
2015-03-13 10:33:26,699 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741936_1112
2015-03-13 10:33:26,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117
2015-03-13 10:33:26,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115
2015-03-13 10:33:26,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110
2015-03-13 10:33:26,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741933_1109
2015-03-13 10:33:26,710 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001/default_container_executor.sh]
2015-03-13 10:33:26,884 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117
2015-03-13 10:33:26,884 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741932_1108
2015-03-13 10:33:26,885 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116
2015-03-13 10:33:26,885 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741934_1110
2015-03-13 10:33:26,886 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741937_1113
2015-03-13 10:33:26,886 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115
2015-03-13 10:33:27,088 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114
2015-03-13 10:33:27,301 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:27,302 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:27,302 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:28,017 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52444 to replicate blk_1073741938_1114 to datanode(s) 127.0.0.1:52451
2015-03-13 10:33:28,017 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741927_1103, blk_1073741928_1104, blk_1073741929_1105, blk_1073741932_1108]
2015-03-13 10:33:28,018 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741927_1103, blk_1073741928_1104, blk_1073741929_1105, blk_1073741930_1106, blk_1073741931_1107, blk_1073741932_1108]
2015-03-13 10:33:28,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:28,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:28,308 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:28,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:33:28,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:33:28,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:33:28,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010	dst=null	perm=null
2015-03-13 10:33:28,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:33:28,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:33:28,645 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927 for deletion
2015-03-13 10:33:28,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928 for deletion
2015-03-13 10:33:28,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929 for deletion
2015-03-13 10:33:28,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930 for deletion
2015-03-13 10:33:28,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931 for deletion
2015-03-13 10:33:28,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932 for deletion
2015-03-13 10:33:28,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927
2015-03-13 10:33:28,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929
2015-03-13 10:33:28,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931
2015-03-13 10:33:28,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928
2015-03-13 10:33:28,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930
2015-03-13 10:33:28,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932
2015-03-13 10:33:28,648 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-218115309-10.1.1.144-52444-1426267834377, infoPort=52445, ipcPort=52446, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 to 127.0.0.1:52451 
2015-03-13 10:33:28,650 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 (numBytes=254067) to /127.0.0.1:52451
2015-03-13 10:33:28,651 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53236 dest: /127.0.0.1:52451
2015-03-13 10:33:28,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114 src: /127.0.0.1:53236 dest: /127.0.0.1:52451 of size 254067
2015-03-13 10:33:28,653 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741938_1114 size 254067
2015-03-13 10:33:28,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:28,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:28,725 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53237, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741940_1116, duration: 148000
2015-03-13 10:33:28,894 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927 for deletion
2015-03-13 10:33:28,894 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928 for deletion
2015-03-13 10:33:28,894 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929 for deletion
2015-03-13 10:33:28,894 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932 for deletion
2015-03-13 10:33:28,895 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927
2015-03-13 10:33:28,895 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929
2015-03-13 10:33:28,895 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928
2015-03-13 10:33:28,895 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932
2015-03-13 10:33:29,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:29,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:29,517 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0010_000001 (auth:SIMPLE)
2015-03-13 10:33:29,519 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0010_000001
2015-03-13 10:33:29,519 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0010	APPATTEMPTID=appattempt_1426267835672_0010_000001
2015-03-13 10:33:29,519 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:33:29,519 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from ACCEPTED to RUNNING
2015-03-13 10:33:29,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:29,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:29,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:29,734 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:29,774 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118 src: /127.0.0.1:53243 dest: /127.0.0.1:52451
2015-03-13 10:33:29,776 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118 src: /127.0.0.1:53244 dest: /127.0.0.1:52444
2015-03-13 10:33:29,777 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118 src: /127.0.0.1:53245 dest: /127.0.0.1:52454
2015-03-13 10:33:29,786 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53245, dest: /127.0.0.1:52454, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, duration: 6939000
2015-03-13 10:33:29,786 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:29,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53244, dest: /127.0.0.1:52444, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, duration: 7791000
2015-03-13 10:33:29,787 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:29,787 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:29,788 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:29,788 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53243, dest: /127.0.0.1:52451, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, duration: 9037000
2015-03-13 10:33:29,789 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:29,789 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:29,794 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:30,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:30,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:30,629 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:30,629 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:30,629 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:33:30,630 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000002, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,630 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:33:30,630 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,631 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:30,631 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:30,631 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:33:30,631 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000003, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,631 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:33:30,632 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,632 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:30,632 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:30,632 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:33:30,633 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000004, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,633 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:33:30,633 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,633 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:30,633 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:30,633 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:33:30,633 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000005, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,634 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:33:30,634 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:30,942 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0009_01_000001 succeeded 
2015-03-13 10:33:30,942 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:33:30,942 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0009_01_000001
2015-03-13 10:33:30,950 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009/container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000001
2015-03-13 10:33:30,951 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0009_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:33:30,951 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0009_01_000001 from application application_1426267835672_0009
2015-03-13 10:33:30,952 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:30,952 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0009
2015-03-13 10:33:31,020 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741927_1103, blk_1073741928_1104, blk_1073741930_1106, blk_1073741931_1107]
2015-03-13 10:33:31,021 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741927_1103, blk_1073741928_1104, blk_1073741929_1105, blk_1073741930_1106, blk_1073741931_1107, blk_1073741932_1108]
2015-03-13 10:33:31,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:33:31,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0009_01_000001
2015-03-13 10:33:31,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:31,317 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0009_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:31,317 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0009_000001
2015-03-13 10:33:31,317 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0009_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:33:31,318 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0009_000001 State change from FINISHING to FINISHED
2015-03-13 10:33:31,318 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0009	CONTAINERID=container_1426267835672_0009_01_000001
2015-03-13 10:33:31,318 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0009 State change from FINISHING to FINISHED
2015-03-13 10:33:31,318 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:31,318 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0009_000001
2015-03-13 10:33:31,318 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:33:31,318 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0009
2015-03-13 10:33:31,319 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0009_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:31,319 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0009,name=[A48777BC2FF94C92AE93C35F857FE6CB/2BD2562F74F34B63B0815D5262A06CC5] null/(1/1) ...tform/testTrapNoOperation,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0009/jobhistory/job/job_1426267835672_0009,appMasterHost=Edinburgh.local,startTime=1426267989538,finishTime=1426268004796,finalStatus=SUCCEEDED
2015-03-13 10:33:31,319 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:31,319 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:33:31,319 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0009_000001 released container container_1426267835672_0009_01_000001 on node: host: 10.1.1.144:52481 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:31,319 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0009_000001 is done. finalState=FINISHED
2015-03-13 10:33:31,319 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0009 requests cleared
2015-03-13 10:33:31,319 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0009 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:33:31,320 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0009 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:33:31,321 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0009_000001 (auth:SIMPLE)
2015-03-13 10:33:31,323 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0009_01_000001
2015-03-13 10:33:31,454 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118
2015-03-13 10:33:31,559 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:31,559 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:31,559 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:31,559 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:31,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:31,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:31,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:31,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:31,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:31,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:31,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:31,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:31,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:31,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:31,632 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:31,633 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0009
2015-03-13 10:33:31,633 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:31,633 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0009, with delay of 10800 seconds
2015-03-13 10:33:31,633 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:31,634 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:31,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:31,636 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:31,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927 for deletion
2015-03-13 10:33:31,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928 for deletion
2015-03-13 10:33:31,646 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929 for deletion
2015-03-13 10:33:31,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927
2015-03-13 10:33:31,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928
2015-03-13 10:33:31,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741929
2015-03-13 10:33:31,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930 for deletion
2015-03-13 10:33:31,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931 for deletion
2015-03-13 10:33:31,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932 for deletion
2015-03-13 10:33:31,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930
2015-03-13 10:33:31,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931
2015-03-13 10:33:31,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741932
2015-03-13 10:33:31,684 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0010_000001 (auth:SIMPLE)
2015-03-13 10:33:31,686 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000005 by user soberoi
2015-03-13 10:33:31,687 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0010
2015-03-13 10:33:31,687 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:31,687 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000003 by user soberoi
2015-03-13 10:33:31,687 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000004 by user soberoi
2015-03-13 10:33:31,687 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:31,687 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from NEW to INITING
2015-03-13 10:33:31,688 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000005 to application application_1426267835672_0010
2015-03-13 10:33:31,688 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000003 to application application_1426267835672_0010
2015-03-13 10:33:31,688 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000004 to application application_1426267835672_0010
2015-03-13 10:33:31,687 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000002 by user soberoi
2015-03-13 10:33:31,688 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from INITING to RUNNING
2015-03-13 10:33:31,688 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:31,688 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:33:31,687 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:31,689 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:33:31,689 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:33:31,689 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000002 to application application_1426267835672_0010
2015-03-13 10:33:31,689 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,689 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,689 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:31,689 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:31,689 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:31,690 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:31,690 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,690 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,690 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:31,690 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:31,690 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,690 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,690 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:31,690 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:31,691 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:33:31,691 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000003
2015-03-13 10:33:31,691 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000004
2015-03-13 10:33:31,692 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000005
2015-03-13 10:33:31,695 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,695 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:31,695 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:31,695 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:31,695 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0010_01_000002
2015-03-13 10:33:31,705 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118
2015-03-13 10:33:31,707 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114
2015-03-13 10:33:31,714 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0010_01_000003.tokens. Credentials list: 
2015-03-13 10:33:31,716 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0010_01_000005.tokens. Credentials list: 
2015-03-13 10:33:31,717 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0010_01_000002.tokens. Credentials list: 
2015-03-13 10:33:31,720 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0010_01_000004.tokens. Credentials list: 
2015-03-13 10:33:31,733 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:31,802 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0010_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003.tokens
2015-03-13 10:33:31,802 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:31,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:31,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:31,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar	dst=null	perm=null
2015-03-13 10:33:31,873 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53250, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1104594832_5096, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741938_1114, duration: 381000
2015-03-13 10:33:31,893 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:31,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:31,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:31,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml	dst=null	perm=null
2015-03-13 10:33:31,917 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53251, bytes: 98926, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1104594832_5096, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741941_1117, duration: 331000
2015-03-13 10:33:31,930 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:31,930 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:31,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:31,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:31,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:31,971 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:31,971 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:31,971 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:31,972 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:31,972 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:31,972 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:31,972 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:31,972 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:32,022 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927 for deletion
2015-03-13 10:33:32,022 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928 for deletion
2015-03-13 10:33:32,022 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930 for deletion
2015-03-13 10:33:32,023 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931 for deletion
2015-03-13 10:33:32,023 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741927
2015-03-13 10:33:32,023 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741930
2015-03-13 10:33:32,023 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741928
2015-03-13 10:33:32,023 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741931
2015-03-13 10:33:32,084 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004/default_container_executor.sh]
2015-03-13 10:33:32,085 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003/default_container_executor.sh]
2015-03-13 10:33:32,085 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005/default_container_executor.sh]
2015-03-13 10:33:32,085 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002/default_container_executor.sh]
2015-03-13 10:33:32,095 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118
2015-03-13 10:33:32,322 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,322 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:32,322 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:32,322 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:32,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:32,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0009
2015-03-13 10:33:32,323 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0009
2015-03-13 10:33:32,323 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:32,323 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0009, with delay of 10800 seconds
2015-03-13 10:33:32,575 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:33:32,637 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:32,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:32,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:32,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:32,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:32,964 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:33,076 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426267835672_0010_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004.tokens
2015-03-13 10:33:33,076 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:33,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:33,310 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426267835672_0010_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002.tokens
2015-03-13 10:33:33,311 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:33,324 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:33,415 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:33,545 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0010_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005.tokens
2015-03-13 10:33:33,545 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:33,641 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:33,641 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:33,641 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:33,642 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,324 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,642 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:34,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,327 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:35,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:36,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,338 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:37,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:38,341 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:38,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:38,438 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53262, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000000_0_-515901384_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 172000
2015-03-13 10:33:38,494 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53263, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000002_0_331976681_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 150000
2015-03-13 10:33:38,513 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53264, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000001_0_-1823108156_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 161000
2015-03-13 10:33:38,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job.split	dst=null	perm=null
2015-03-13 10:33:38,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:38,577 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53262, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000000_0_-515901384_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 186000
2015-03-13 10:33:38,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:38,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:38,625 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53267, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000002_0_331976681_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 186000
2015-03-13 10:33:38,640 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53266, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000003_0_-1525903624_1, offset: 1024, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741939_1115, duration: 148000
2015-03-13 10:33:38,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:38,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:38,730 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53268, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000003_0_-1525903624_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 157000
2015-03-13 10:33:38,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_m_000000_0	dst=null	perm=null
2015-03-13 10:33:38,988 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53269, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0010_m_000001_0_-1823108156_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1062000
2015-03-13 10:33:39,015 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000002
2015-03-13 10:33:39,015 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:39,015 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:33:39,015 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000002
2015-03-13 10:33:39,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:39,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,027 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000002 is : 143
2015-03-13 10:33:39,032 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:39,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119 src: /127.0.0.1:53270 dest: /127.0.0.1:52454
2015-03-13 10:33:39,036 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119 src: /127.0.0.1:53271 dest: /127.0.0.1:52447
2015-03-13 10:33:39,038 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119 src: /127.0.0.1:53272 dest: /127.0.0.1:52451
2015-03-13 10:33:39,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_m_000001_0	dst=null	perm=null
2015-03-13 10:33:39,047 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:39,048 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002
2015-03-13 10:33:39,048 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002
2015-03-13 10:33:39,048 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:39,048 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002
2015-03-13 10:33:39,049 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000002
2015-03-13 10:33:39,049 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:39,049 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000002 from application application_1426267835672_0010
2015-03-13 10:33:39,049 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:39,049 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:39,050 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist for DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:39,050 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 1038 Total time for transactions(ms): 71 Number of transactions batched in Syncs: 20 Number of syncs: 577 SyncTimes(ms): 156 100 
2015-03-13 10:33:39,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_m_000002_0	dst=null	perm=null
2015-03-13 10:33:39,067 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000003
2015-03-13 10:33:39,068 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:39,068 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:33:39,068 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000003
2015-03-13 10:33:39,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:39,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000002
2015-03-13 10:33:39,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:39,069 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,069 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,069 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:39,069 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:33:39,069 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000002
2015-03-13 10:33:39,070 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:33:39,070 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:33:39,070 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000002, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,070 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,070 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:39,070 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000002 on node: host: 10.1.1.144:52477 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:33:39,080 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000003 is : 143
2015-03-13 10:33:39,093 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:39,093 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000004
2015-03-13 10:33:39,093 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:39,093 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003
2015-03-13 10:33:39,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:39,094 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,094 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003
2015-03-13 10:33:39,094 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:39,096 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003
2015-03-13 10:33:39,096 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000003
2015-03-13 10:33:39,097 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:33:39,097 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:39,097 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:39,097 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000004
2015-03-13 10:33:39,107 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000004 is : 143
2015-03-13 10:33:39,118 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000003 from application application_1426267835672_0010
2015-03-13 10:33:39,118 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:39,119 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:39,119 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:39,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004
2015-03-13 10:33:39,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004
2015-03-13 10:33:39,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004
2015-03-13 10:33:39,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000004
2015-03-13 10:33:39,121 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:39,121 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:39,122 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000004 from application application_1426267835672_0010
2015-03-13 10:33:39,122 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:39,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:39,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_m_000003_0	dst=null	perm=null
2015-03-13 10:33:39,181 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000005
2015-03-13 10:33:39,181 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:39,181 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:33:39,182 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000005
2015-03-13 10:33:39,182 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:39,182 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000003
2015-03-13 10:33:39,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:39,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000004
2015-03-13 10:33:39,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:39,183 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:39,183 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:33:39,184 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000003
2015-03-13 10:33:39,184 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:33:39,184 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:39,184 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000003, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,184 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,184 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:33:39,184 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000003 on node: host: 10.1.1.144:52477 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:39,184 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:39,184 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:33:39,185 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000004
2015-03-13 10:33:39,185 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:33:39,185 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:33:39,185 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000004, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,185 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:39,185 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:39,185 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000004 on node: host: 10.1.1.144:52477 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:33:39,192 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000005 is : 143
2015-03-13 10:33:39,199 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:39,199 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005
2015-03-13 10:33:39,199 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005
2015-03-13 10:33:39,200 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005
2015-03-13 10:33:39,200 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000005
2015-03-13 10:33:39,200 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:39,200 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:39,200 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000005 from application application_1426267835672_0010
2015-03-13 10:33:39,200 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:39,201 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:39,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:40,189 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:40,189 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000005
2015-03-13 10:33:40,190 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:40,190 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:33:40,190 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000005
2015-03-13 10:33:40,190 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:40,190 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:40,190 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000005, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:40,191 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:40,191 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:40,191 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000005 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:40,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:41,192 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:41,192 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:41,192 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:33:41,192 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0010 container=Container: [ContainerId: container_1426267835672_0010_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0010_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:41,193 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:41,193 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:41,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:41,609 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:41,617 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0010_01_000006 by user soberoi
2015-03-13 10:33:41,617 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:41,617 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0010_01_000006 to application application_1426267835672_0010
2015-03-13 10:33:41,618 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:33:41,618 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0010
2015-03-13 10:33:41,618 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0010
2015-03-13 10:33:41,618 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:41,618 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0010
2015-03-13 10:33:41,619 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:41,644 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:41,645 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:41,723 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006/default_container_executor.sh]
2015-03-13 10:33:42,046 INFO  hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:33:42,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:33:42,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:33:42,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary	dst=null	perm=null
2015-03-13 10:33:42,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary	dst=null	perm=null
2015-03-13 10:33:42,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary	dst=null	perm=null
2015-03-13 10:33:42,059 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53274, bytes: 428, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741837_1013, duration: 484000
2015-03-13 10:33:42,060 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0001,submitTime=1426267844168,launchTime=1426267847629,firstMapTaskLaunchTime=1426267849787,firstReduceTaskLaunchTime=1426267860731,finishTime=1426267863543,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotSeconds=2,jobName=[61C1702FCC0A429FBD628FD813F0535B/26757E2D2BB340BFA59A7DCBA8B66383] trap test/(1/2)
2015-03-13 10:33:42,060 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary]
2015-03-13 10:33:42,061 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53275, bytes: 456, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741848_1024, duration: 227000
2015-03-13 10:33:42,061 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0002,submitTime=1426267864937,launchTime=1426267868427,firstMapTaskLaunchTime=1426267870576,firstReduceTaskLaunchTime=1426267875504,finishTime=1426267878416,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=1,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=2,reduceSlotSeconds=2,jobName=[61C1702FCC0A429FBD628FD813F0535B/79C6C455F92F4DC7B488B1927023B72E] trap test/(2/2) ...atform/eacheverychain/tap
2015-03-13 10:33:42,063 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary]
2015-03-13 10:33:42,064 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53276, bytes: 457, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741858_1034, duration: 185000
2015-03-13 10:33:42,065 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741837_1013 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:33:42,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001.summary	dst=null	perm=null
2015-03-13 10:33:42,065 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0003,submitTime=1426267879845,launchTime=1426267883352,firstMapTaskLaunchTime=1426267885517,firstReduceTaskLaunchTime=1426267895452,finishTime=1426267898057,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=2,jobName=[A5DA9BA04876490E83B797AC0CE57F3F/1D775ED593824D6FA1483A7D4ADBD8AA] trap test/(1/1) ...atform/everyaggregate/tap
2015-03-13 10:33:42,065 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary]
2015-03-13 10:33:42,066 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:33:42,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002.summary	dst=null	perm=null
2015-03-13 10:33:42,072 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741858_1034 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52447 
2015-03-13 10:33:42,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003.summary	dst=null	perm=null
2015-03-13 10:33:42,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,076 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,076 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,077 INFO  hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(885)) - Perms after creating 504, Expected: 504
2015-03-13 10:33:42,078 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0003-1426267879845-soberoi-%5BA5DA9BA04876490E83B797AC0CE57F3F%2F1D775ED593824D6F-1426267898057-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0002-1426267864937-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F79C6C455F92F4DC7-1426267878416-1-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,083 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0003_conf.xml
2015-03-13 10:33:42,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0001-1426267844168-soberoi-%5B61C1702FCC0A429FBD628FD813F0535B%2F26757E2D2BB340BF-1426267863543-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,083 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0002_conf.xml
2015-03-13 10:33:42,083 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0001_conf.xml
2015-03-13 10:33:42,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0003_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0003_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0001_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0002_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0002_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary	dst=null	perm=null
2015-03-13 10:33:42,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary	dst=null	perm=null
2015-03-13 10:33:42,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary	dst=null	perm=null
2015-03-13 10:33:42,089 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53276, bytes: 456, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741883_1059, duration: 165000
2015-03-13 10:33:42,089 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53275, bytes: 457, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741893_1069, duration: 152000
2015-03-13 10:33:42,090 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0005,submitTime=1426267919207,launchTime=1426267922646,firstMapTaskLaunchTime=1426267924787,firstReduceTaskLaunchTime=1426267930720,finishTime=1426267933389,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=1,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=3,reduceSlotSeconds=2,jobName=[AA7C1D7EA74C4401BE2D2CFBE5BCEEF1/5E7BEE4954DF42539615E4FD31314DC4] trap test/(1/1) ...tform/trapsourcesink/sink
2015-03-13 10:33:42,090 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53277, bytes: 457, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741871_1047, duration: 135000
2015-03-13 10:33:42,090 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0006,submitTime=1426267934765,launchTime=1426267938292,firstMapTaskLaunchTime=1426267940450,firstReduceTaskLaunchTime=1426267950380,finishTime=1426267953307,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotSeconds=2,jobName=[2E6720DC81AE485EA9AF60ED96CF5170/FD9C0A1F88154A1F92C3C9299F12FC78] trap test/(1/1) ...latform/everycomplete/tap
2015-03-13 10:33:42,090 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary]
2015-03-13 10:33:42,090 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary]
2015-03-13 10:33:42,090 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0004,submitTime=1426267899477,launchTime=1426267903236,firstMapTaskLaunchTime=1426267905398,firstReduceTaskLaunchTime=1426267915323,finishTime=1426267917806,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotSeconds=2,jobName=[556A3EF415294468966B68292BE360F8/1F24603F771643C9A3DB4171C3FE2709] trap test/(1/1) ...-mr1/trapplatform/all/tap
2015-03-13 10:33:42,091 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary]
2015-03-13 10:33:42,092 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741893_1069 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:33:42,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006.summary	dst=null	perm=null
2015-03-13 10:33:42,092 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741883_1059 127.0.0.1:52444 127.0.0.1:52447 127.0.0.1:52451 
2015-03-13 10:33:42,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005.summary	dst=null	perm=null
2015-03-13 10:33:42,092 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741871_1047 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52451 
2015-03-13 10:33:42,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004.summary	dst=null	perm=null
2015-03-13 10:33:42,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,095 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,095 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,095 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0006-1426267934765-soberoi-%5B2E6720DC81AE485EA9AF60ED96CF5170%2FFD9C0A1F88154A1F-1426267953307-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0004-1426267899477-soberoi-%5B556A3EF415294468966B68292BE360F8%2F1F24603F771643C9-1426267917806-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,096 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0006_conf.xml
2015-03-13 10:33:42,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0005-1426267919207-soberoi-%5BAA7C1D7EA74C4401BE2D2CFBE5BCEEF1%2F5E7BEE4954DF4253-1426267933389-1-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,097 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0004_conf.xml
2015-03-13 10:33:42,097 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0005_conf.xml
2015-03-13 10:33:42,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0006_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0006_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0004_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0004_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0005_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0005_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary	dst=null	perm=null
2015-03-13 10:33:42,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary	dst=null	perm=null
2015-03-13 10:33:42,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary	dst=null	perm=null
2015-03-13 10:33:42,100 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53277, bytes: 457, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741923_1099, duration: 168000
2015-03-13 10:33:42,100 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0008,submitTime=1426267969680,launchTime=1426267973437,firstMapTaskLaunchTime=1426267975608,firstReduceTaskLaunchTime=1426267985538,finishTime=1426267988140,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=4,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=2,jobName=[F9B537FAC95645ECA39BE2CD77067409/E03532BB4F26472AB8B07F9C2D7BA44F] trap test/(1/1) ...-mr1/trapplatform/seq/tap
2015-03-13 10:33:42,100 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary]
2015-03-13 10:33:42,100 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0007,submitTime=1426267954642,launchTime=1426267958248,firstMapTaskLaunchTime=1426267960403,firstReduceTaskLaunchTime=0,finishTime=1426267968284,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=4,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=0,jobName=[F2851B067A5340D8BCD42F553ADE00B9/2D32D0260D4B4807B8F7ECFBFF3D0CCC] trap test/(1/1) ...hain/tap-nondeterministic
2015-03-13 10:33:42,100 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary]
2015-03-13 10:33:42,100 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53274, bytes: 442, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741910_1086, duration: 219000
2015-03-13 10:33:42,101 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53278, bytes: 437, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1827264275_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741935_1111, duration: 176000
2015-03-13 10:33:42,102 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741923_1099 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:33:42,102 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426267835672_0009,submitTime=1426267989538,launchTime=1426267993335,firstMapTaskLaunchTime=1426267995505,firstReduceTaskLaunchTime=0,finishTime=1426268004678,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=44,reduceSlotSeconds=0,jobName=[A48777BC2FF94C92AE93C35F857FE6CB/2BD2562F74F34B63B0815D5262A06CC5] null/(1/1) ...tform/testTrapNoOperation
2015-03-13 10:33:42,102 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary]
2015-03-13 10:33:42,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008.summary	dst=null	perm=null
2015-03-13 10:33:42,102 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741910_1086 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444 
2015-03-13 10:33:42,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007.summary	dst=null	perm=null
2015-03-13 10:33:42,104 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741935_1111 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52451 
2015-03-13 10:33:42,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009.summary	dst=null	perm=null
2015-03-13 10:33:42,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,105 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist
2015-03-13 10:33:42,105 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist
2015-03-13 10:33:42,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:33:42,109 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist
2015-03-13 10:33:42,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0007-1426267954642-soberoi-%5BF2851B067A5340D8BCD42F553ADE00B9%2F2D32D0260D4B4807-1426267968284-4-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0008-1426267969680-soberoi-%5BF9B537FAC95645ECA39BE2CD77067409%2FE03532BB4F26472A-1426267988140-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,109 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0007_conf.xml
2015-03-13 10:33:42,110 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0008_conf.xml
2015-03-13 10:33:42,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0009-1426267989538-soberoi-%5BA48777BC2FF94C92AE93C35F857FE6CB%2F2BD2562F74F34B63-1426268004678-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,110 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml to hdfs://localhost:52443/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0009_conf.xml
2015-03-13 10:33:42,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0007_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0007_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0008_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0008_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0009_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426267835672_0009_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:42,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:42,193 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:42,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:42,616 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:33:43,030 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741858_1034, blk_1073741910_1086, blk_1073741848_1024, blk_1073741837_1013, blk_1073741935_1111, blk_1073741871_1047]
2015-03-13 10:33:43,030 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741858_1034, blk_1073741923_1099, blk_1073741893_1069, blk_1073741848_1024, blk_1073741883_1059, blk_1073741837_1013, blk_1073741935_1111, blk_1073741871_1047]
2015-03-13 10:33:43,196 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:43,358 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:43,647 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858 for deletion
2015-03-13 10:33:43,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923 for deletion
2015-03-13 10:33:43,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893 for deletion
2015-03-13 10:33:43,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848 for deletion
2015-03-13 10:33:43,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858
2015-03-13 10:33:43,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883 for deletion
2015-03-13 10:33:43,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848
2015-03-13 10:33:43,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923
2015-03-13 10:33:43,648 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837 for deletion
2015-03-13 10:33:43,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893
2015-03-13 10:33:43,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883
2015-03-13 10:33:43,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871 for deletion
2015-03-13 10:33:43,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935 for deletion
2015-03-13 10:33:43,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837
2015-03-13 10:33:43,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871
2015-03-13 10:33:43,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935
2015-03-13 10:33:44,034 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858 for deletion
2015-03-13 10:33:44,034 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910 for deletion
2015-03-13 10:33:44,034 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848 for deletion
2015-03-13 10:33:44,034 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837 for deletion
2015-03-13 10:33:44,034 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871 for deletion
2015-03-13 10:33:44,034 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935 for deletion
2015-03-13 10:33:44,035 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858
2015-03-13 10:33:44,035 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848
2015-03-13 10:33:44,035 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837
2015-03-13 10:33:44,036 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935
2015-03-13 10:33:44,036 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910
2015-03-13 10:33:44,036 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871
2015-03-13 10:33:44,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:44,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:44,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,186 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:44,197 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:44,247 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120 src: /127.0.0.1:53283 dest: /127.0.0.1:52454
2015-03-13 10:33:44,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120 src: /127.0.0.1:53284 dest: /127.0.0.1:52447
2015-03-13 10:33:44,249 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120 src: /127.0.0.1:53285 dest: /127.0.0.1:52444
2015-03-13 10:33:44,260 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53285, dest: /127.0.0.1:52444, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 8780000
2015-03-13 10:33:44,260 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,260 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:44,260 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53284, dest: /127.0.0.1:52447, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 9492000
2015-03-13 10:33:44,261 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,261 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:44,261 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53283, dest: /127.0.0.1:52454, bytes: 112, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 10538000
2015-03-13 10:33:44,262 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,262 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:33:44,265 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000 is closed by DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1
2015-03-13 10:33:44,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:33:44,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:33:44,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:33:44,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:33:44,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:33:44,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:44,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:33:44,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0/part-r-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/part-r-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary/_attempt_1426267835672_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:33:44,294 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0010_r_000000_0_579570559_1
2015-03-13 10:33:44,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:33:44,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:33:44,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/task_1426267835672_0010_r_000000	dst=null	perm=null
2015-03-13 10:33:44,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/_temporary/attempt_1426267835672_0010_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/task_1426267835672_0010_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:44,313 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000006
2015-03-13 10:33:44,314 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:44,314 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:33:44,314 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000006
2015-03-13 10:33:44,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:44,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,321 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1	dst=null	perm=null
2015-03-13 10:33:44,326 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0010_01_000006 is : 143
2015-03-13 10:33:44,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:44,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:44,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/task_1426267835672_0010_r_000000	dst=null	perm=null
2015-03-13 10:33:44,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000	dst=null	perm=null
2015-03-13 10:33:44,339 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:44,339 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006
2015-03-13 10:33:44,339 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006
2015-03-13 10:33:44,340 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:44,340 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:44,340 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000006 from application application_1426267835672_0010
2015-03-13 10:33:44,340 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006
2015-03-13 10:33:44,340 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000006
2015-03-13 10:33:44,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary/1/task_1426267835672_0010_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,340 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:44,341 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:44,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary	dst=null	perm=null
2015-03-13 10:33:44,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,351 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,354 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,360 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:44,368 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53272, dest: /127.0.0.1:52451, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, duration: 5328958000
2015-03-13 10:33:44,369 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,369 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,370 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53271, dest: /127.0.0.1:52447, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, duration: 5329056000
2015-03-13 10:33:44,370 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,371 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,371 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53270, dest: /127.0.0.1:52454, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, duration: 5331591000
2015-03-13 10:33:44,371 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,372 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,373 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,377 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:44,379 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121 src: /127.0.0.1:53286 dest: /127.0.0.1:52444
2015-03-13 10:33:44,380 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121 src: /127.0.0.1:53287 dest: /127.0.0.1:52454
2015-03-13 10:33:44,381 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121 src: /127.0.0.1:53288 dest: /127.0.0.1:52447
2015-03-13 10:33:44,384 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53288, dest: /127.0.0.1:52447, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, duration: 1247000
2015-03-13 10:33:44,384 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,385 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:44,385 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53287, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, duration: 1838000
2015-03-13 10:33:44,385 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,385 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:44,386 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53286, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, duration: 2741000
2015-03-13 10:33:44,386 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,386 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:44,388 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist	dst=null	perm=null
2015-03-13 10:33:44,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:33:44,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist	dst=null	perm=null
2015-03-13 10:33:44,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:33:44,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1.jhist	dst=null	perm=null
2015-03-13 10:33:44,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,405 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53289, bytes: 60210, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119, duration: 220000
2015-03-13 10:33:44,407 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:33:44,408 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122 src: /127.0.0.1:53290 dest: /127.0.0.1:52447
2015-03-13 10:33:44,410 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122 src: /127.0.0.1:53291 dest: /127.0.0.1:52451
2015-03-13 10:33:44,411 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122 src: /127.0.0.1:53292 dest: /127.0.0.1:52454
2015-03-13 10:33:44,414 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53292, dest: /127.0.0.1:52454, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, duration: 1334000
2015-03-13 10:33:44,414 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,414 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:44,414 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53291, dest: /127.0.0.1:52451, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, duration: 1871000
2015-03-13 10:33:44,415 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,415 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:44,415 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53290, dest: /127.0.0.1:52447, bytes: 59742, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, duration: 2721000
2015-03-13 10:33:44,415 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,416 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:33:44,418 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:44,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:33:44,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:44,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:33:44,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010/job_1426267835672_0010_1_conf.xml	dst=null	perm=null
2015-03-13 10:33:44,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:44,429 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53289, bytes: 91461, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741942_1118, duration: 281000
2015-03-13 10:33:44,431 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:44,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123 src: /127.0.0.1:53293 dest: /127.0.0.1:52444
2015-03-13 10:33:44,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123 src: /127.0.0.1:53294 dest: /127.0.0.1:52447
2015-03-13 10:33:44,436 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123 src: /127.0.0.1:53295 dest: /127.0.0.1:52451
2015-03-13 10:33:44,440 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53295, dest: /127.0.0.1:52451, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, duration: 2146000
2015-03-13 10:33:44,440 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:44,441 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,441 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53294, dest: /127.0.0.1:52447, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, duration: 2754000
2015-03-13 10:33:44,441 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,443 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53293, dest: /127.0.0.1:52444, bytes: 90749, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1835520610_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, duration: 4783000
2015-03-13 10:33:44,443 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:44,444 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,445 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:44,447 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1835520610_1
2015-03-13 10:33:44,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0010-1426268006031-soberoi-%5B424430AA625046EFAE20EBF78BBDDDC5%2FB5554EC049CD4334-1426268024354-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:33:44,459 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from RUNNING to FINISHING
2015-03-13 10:33:44,460 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0010
2015-03-13 10:33:44,460 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from RUNNING to REMOVING
2015-03-13 10:33:44,460 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0010
2015-03-13 10:33:44,460 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from REMOVING to FINISHING
2015-03-13 10:33:45,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:45,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000006
2015-03-13 10:33:45,316 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:45,316 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:33:45,316 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000006
2015-03-13 10:33:45,316 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:45,316 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:45,317 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:45,317 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:45,317 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:45,317 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000006 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:45,365 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:45,469 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741938_1114 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 
2015-03-13 10:33:45,470 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741939_1115 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52444 
2015-03-13 10:33:45,470 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741940_1116 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 
2015-03-13 10:33:45,470 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741941_1117 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 
2015-03-13 10:33:45,470 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741943_1119 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52451 
2015-03-13 10:33:45,471 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741942_1118 127.0.0.1:52451 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:33:45,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0010	dst=null	perm=null
2015-03-13 10:33:45,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:45,501 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary
2015-03-13 10:33:45,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/_temporary	dst=null	perm=null
2015-03-13 10:33:45,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:45,502 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary
2015-03-13 10:33:45,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:45,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/_temporary	dst=null	perm=null
2015-03-13 10:33:45,511 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:45,511 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:45,512 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:45,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:45,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:45,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:45,514 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:45,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000	dst=null	perm=null
2015-03-13 10:33:45,521 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:45,522 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:45,522 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:45,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:45,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:45,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:45,525 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:45,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:33:45,528 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53296, bytes: 116, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 174000
2015-03-13 10:33:45,528 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everystart/tap
2015-03-13 10:33:45,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:45,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:45,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:45,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap	dst=null	perm=null
2015-03-13 10:33:45,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000	dst=null	perm=null
2015-03-13 10:33:45,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/tap/part-00000	dst=null	perm=null
2015-03-13 10:33:45,532 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/everystart/trap
2015-03-13 10:33:45,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:45,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:45,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:45,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap	dst=null	perm=null
2015-03-13 10:33:45,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:33:45,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/everystart/trap/part-r-00001-00000	dst=null	perm=null
2015-03-13 10:33:45,537 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53297, bytes: 116, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120, duration: 163000
2015-03-13 10:33:45,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:45,547 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:45,548 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:33:45,548 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:33:45,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:33:45,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap	dst=null	perm=null
2015-03-13 10:33:45,559 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:33:45,559 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:33:45,559 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap"]
2015-03-13 10:33:45,559 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:33:45,559 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:33:45,559 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:33:45,560 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...mr1/trapplatform/none/tap
2015-03-13 10:33:45,570 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:45,577 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:45,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:33:45,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:45,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:45,581 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 11
2015-03-13 10:33:45,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011	dst=null	perm=null
2015-03-13 10:33:45,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:33:45,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:33:45,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:45,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,588 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:45,589 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53299 dest: /127.0.0.1:52447
2015-03-13 10:33:45,590 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53300 dest: /127.0.0.1:52454
2015-03-13 10:33:45,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53301 dest: /127.0.0.1:52451
2015-03-13 10:33:45,595 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53301, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 1850000
2015-03-13 10:33:45,596 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:45,596 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53300, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 2620000
2015-03-13 10:33:45,596 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,597 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53299, dest: /127.0.0.1:52447, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 3595000
2015-03-13 10:33:45,597 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,598 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,599 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:45,600 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar
2015-03-13 10:33:45,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:45,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:45,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:45,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:45,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:33:45,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:33:45,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:33:45,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:33:45,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:33:45,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:45,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:45,607 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:33:45,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:45,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,611 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split
2015-03-13 10:33:45,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:45,613 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:45,614 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125 src: /127.0.0.1:53302 dest: /127.0.0.1:52454
2015-03-13 10:33:45,615 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125 src: /127.0.0.1:53303 dest: /127.0.0.1:52444
2015-03-13 10:33:45,617 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125 src: /127.0.0.1:53304 dest: /127.0.0.1:52451
2015-03-13 10:33:45,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125 src: /127.0.0.1:53305 dest: /127.0.0.1:52447
2015-03-13 10:33:45,621 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53305, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 1638000
2015-03-13 10:33:45,621 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:45,622 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,622 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53304, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 2161000
2015-03-13 10:33:45,622 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,622 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53303, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 3147000
2015-03-13 10:33:45,623 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,623 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53302, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 3566000
2015-03-13 10:33:45,623 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,627 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,628 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:45,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,632 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:45,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126 src: /127.0.0.1:53306 dest: /127.0.0.1:52444
2015-03-13 10:33:45,635 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126 src: /127.0.0.1:53307 dest: /127.0.0.1:52454
2015-03-13 10:33:45,636 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126 src: /127.0.0.1:53308 dest: /127.0.0.1:52451
2015-03-13 10:33:45,638 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53308, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 1030000
2015-03-13 10:33:45,638 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:45,639 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,639 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53307, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 1499000
2015-03-13 10:33:45,639 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,639 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,640 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53306, dest: /127.0.0.1:52444, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 2263000
2015-03-13 10:33:45,640 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,641 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:45,642 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:45,642 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:33:45,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:33:45,645 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:33:45,646 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:33:45,646 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:33:45,649 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:33:45,650 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127 src: /127.0.0.1:53309 dest: /127.0.0.1:52454
2015-03-13 10:33:45,651 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127 src: /127.0.0.1:53310 dest: /127.0.0.1:52444
2015-03-13 10:33:45,652 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127 src: /127.0.0.1:53311 dest: /127.0.0.1:52447
2015-03-13 10:33:45,655 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53311, dest: /127.0.0.1:52447, bytes: 97998, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 1677000
2015-03-13 10:33:45,655 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:45,655 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,656 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53310, dest: /127.0.0.1:52444, bytes: 97998, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 2107000
2015-03-13 10:33:45,656 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,656 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,656 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53309, dest: /127.0.0.1:52454, bytes: 97998, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 2952000
2015-03-13 10:33:45,657 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:45,657 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:33:45,658 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:33:45,658 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0011
2015-03-13 10:33:45,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011	dst=null	perm=null
2015-03-13 10:33:45,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:45,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:45,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:45,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:45,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:45,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:45,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:45,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:45,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:45,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:45,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:45,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:45,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:45,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:45,671 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 11 submitted by user soberoi
2015-03-13 10:33:45,671 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0011
2015-03-13 10:33:45,671 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0011
2015-03-13 10:33:45,671 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0011
2015-03-13 10:33:45,671 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from NEW to NEW_SAVING
2015-03-13 10:33:45,671 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:33:45,671 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0011_000001
2015-03-13 10:33:45,672 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from NEW to SUBMITTED
2015-03-13 10:33:45,672 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0011 from user: soberoi activated in queue: default
2015-03-13 10:33:45,672 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0011 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:33:45,672 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0011 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:33:45,672 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0011 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:33:45,672 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0011_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:33:45,673 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:33:45,673 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from SUBMITTED to ACCEPTED
2015-03-13 10:33:45,675 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0011/
2015-03-13 10:33:45,675 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0011
2015-03-13 10:33:45,675 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0011/
2015-03-13 10:33:46,036 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52451 to replicate blk_1073741948_1124 to datanode(s) 127.0.0.1:52444
2015-03-13 10:33:46,036 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741938_1114, blk_1073741939_1115, blk_1073741940_1116, blk_1073741942_1118, blk_1073741943_1119]
2015-03-13 10:33:46,036 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741938_1114, blk_1073741939_1115, blk_1073741941_1117, blk_1073741943_1119]
2015-03-13 10:33:46,317 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:46,317 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000001
2015-03-13 10:33:46,317 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:33:46,317 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0011_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:46,317 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:33:46,317 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:46,317 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:46,318 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0011 AttemptId: appattempt_1426267835672_0011_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ]
2015-03-13 10:33:46,318 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:33:46,319 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0011_000001
2015-03-13 10:33:46,319 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:33:46,319 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0011_000001
2015-03-13 10:33:46,319 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0011_000001
2015-03-13 10:33:46,320 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0011_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:33:46,322 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:33:46,324 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000001 by user soberoi
2015-03-13 10:33:46,324 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0011
2015-03-13 10:33:46,325 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000001
2015-03-13 10:33:46,325 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from NEW to INITING
2015-03-13 10:33:46,325 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000001 to application application_1426267835672_0011
2015-03-13 10:33:46,325 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from INITING to RUNNING
2015-03-13 10:33:46,325 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] for AM appattempt_1426267835672_0011_000001
2015-03-13 10:33:46,325 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:33:46,325 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:33:46,325 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:46,326 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:46,326 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:33:46,326 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:33:46,326 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:46,326 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0011_01_000001
2015-03-13 10:33:46,334 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0011_01_000001.tokens. Credentials list: 
2015-03-13 10:33:46,349 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:46,367 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:46,418 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0011_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001.tokens
2015-03-13 10:33:46,418 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:33:46,463 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122
2015-03-13 10:33:46,463 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119
2015-03-13 10:33:46,464 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125
2015-03-13 10:33:46,465 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124
2015-03-13 10:33:46,465 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121
2015-03-13 10:33:46,465 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126
2015-03-13 10:33:46,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:46,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:46,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:46,485 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120
2015-03-13 10:33:46,485 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127
2015-03-13 10:33:46,487 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124
2015-03-13 10:33:46,487 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125
2015-03-13 10:33:46,489 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53296, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1775258973_5462, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 540000
2015-03-13 10:33:46,508 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:46,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:46,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:46,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:46,533 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53315, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1775258973_5462, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 181000
2015-03-13 10:33:46,546 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:46,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:46,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:46,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:46,570 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53316, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1775258973_5462, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 195000
2015-03-13 10:33:46,583 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:46,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:46,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:46,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:46,606 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53296, bytes: 98766, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1775258973_5462, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 314000
2015-03-13 10:33:46,620 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:46,620 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:46,645 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:46,645 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:46,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938 for deletion
2015-03-13 10:33:46,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939 for deletion
2015-03-13 10:33:46,649 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941 for deletion
2015-03-13 10:33:46,650 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943 for deletion
2015-03-13 10:33:46,650 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938
2015-03-13 10:33:46,650 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939
2015-03-13 10:33:46,650 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941
2015-03-13 10:33:46,650 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943
2015-03-13 10:33:46,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127
2015-03-13 10:33:46,669 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120
2015-03-13 10:33:46,688 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119
2015-03-13 10:33:46,689 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122
2015-03-13 10:33:46,689 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121
2015-03-13 10:33:46,690 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123
2015-03-13 10:33:46,716 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001/default_container_executor.sh]
2015-03-13 10:33:46,717 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125
2015-03-13 10:33:46,719 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124
2015-03-13 10:33:46,719 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126
2015-03-13 10:33:46,908 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 to 127.0.0.1:52444 
2015-03-13 10:33:46,909 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53317 dest: /127.0.0.1:52444
2015-03-13 10:33:46,909 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 (numBytes=254067) to /127.0.0.1:52444
2015-03-13 10:33:46,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124 src: /127.0.0.1:53317 dest: /127.0.0.1:52444 of size 254067
2015-03-13 10:33:46,911 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741948_1124 size 254067
2015-03-13 10:33:46,921 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741946_1122
2015-03-13 10:33:46,922 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123
2015-03-13 10:33:46,922 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741943_1119
2015-03-13 10:33:47,035 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938 for deletion
2015-03-13 10:33:47,035 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939 for deletion
2015-03-13 10:33:47,035 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940 for deletion
2015-03-13 10:33:47,035 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938
2015-03-13 10:33:47,036 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939
2015-03-13 10:33:47,036 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940
2015-03-13 10:33:47,035 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942 for deletion
2015-03-13 10:33:47,036 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943 for deletion
2015-03-13 10:33:47,036 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942
2015-03-13 10:33:47,036 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943
2015-03-13 10:33:47,103 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741945_1121
2015-03-13 10:33:47,104 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741944_1120
2015-03-13 10:33:47,104 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125
2015-03-13 10:33:47,104 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127
2015-03-13 10:33:47,307 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124
2015-03-13 10:33:47,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:47,317 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:47,373 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:47,509 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741947_1123
2015-03-13 10:33:47,509 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126
2015-03-13 10:33:48,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:33:48,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:33:48,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:33:48,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:33:48,321 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:48,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011	dst=null	perm=null
2015-03-13 10:33:48,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:33:48,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:33:48,376 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:48,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:48,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:33:48,679 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53319, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741950_1126, duration: 183000
2015-03-13 10:33:49,042 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741938_1114, blk_1073741939_1115, blk_1073741923_1099, blk_1073741940_1116, blk_1073741941_1117, blk_1073741893_1069, blk_1073741942_1118, blk_1073741910_1086, blk_1073741943_1119, blk_1073741883_1059, blk_1073741935_1111, blk_1073741871_1047]
2015-03-13 10:33:49,042 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741938_1114, blk_1073741858_1034, blk_1073741939_1115, blk_1073741923_1099, blk_1073741940_1116, blk_1073741941_1117, blk_1073741893_1069, blk_1073741942_1118, blk_1073741910_1086, blk_1073741848_1024, blk_1073741883_1059, blk_1073741837_1013]
2015-03-13 10:33:49,322 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:49,377 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:49,441 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:33:49,442 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0011_000001
2015-03-13 10:33:49,443 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0011	APPATTEMPTID=appattempt_1426267835672_0011_000001
2015-03-13 10:33:49,444 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:33:49,445 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from ACCEPTED to RUNNING
2015-03-13 10:33:49,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:49,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:33:49,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:33:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858 for deletion
2015-03-13 10:33:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938 for deletion
2015-03-13 10:33:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923 for deletion
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741858
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939 for deletion
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940 for deletion
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893 for deletion
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941 for deletion
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940
2015-03-13 10:33:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910 for deletion
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942 for deletion
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848 for deletion
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883 for deletion
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837 for deletion
2015-03-13 10:33:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741848
2015-03-13 10:33:49,654 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883
2015-03-13 10:33:49,654 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741837_1013 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741837
2015-03-13 10:33:49,676 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:33:49,713 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128 src: /127.0.0.1:53325 dest: /127.0.0.1:52454
2015-03-13 10:33:49,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128 src: /127.0.0.1:53326 dest: /127.0.0.1:52447
2015-03-13 10:33:49,716 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128 src: /127.0.0.1:53327 dest: /127.0.0.1:52451
2015-03-13 10:33:49,725 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53327, dest: /127.0.0.1:52451, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, duration: 7308000
2015-03-13 10:33:49,725 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:33:49,726 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:49,726 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53326, dest: /127.0.0.1:52447, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, duration: 7927000
2015-03-13 10:33:49,726 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:49,727 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:49,727 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53325, dest: /127.0.0.1:52454, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, duration: 8819000
2015-03-13 10:33:49,727 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:33:49,727 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:33:49,731 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:33:49,912 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938 for deletion
2015-03-13 10:33:49,912 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923 for deletion
2015-03-13 10:33:49,912 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939 for deletion
2015-03-13 10:33:49,912 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940 for deletion
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893 for deletion
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741939
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941 for deletion
2015-03-13 10:33:49,912 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741938
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910 for deletion
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942 for deletion
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741923_1099 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741923
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943 for deletion
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883 for deletion
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741941
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741940
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871 for deletion
2015-03-13 10:33:49,913 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935 for deletion
2015-03-13 10:33:49,914 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741893
2015-03-13 10:33:49,914 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741942
2015-03-13 10:33:49,914 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741910_1086 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741910
2015-03-13 10:33:49,914 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741883
2015-03-13 10:33:49,914 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741943
2015-03-13 10:33:49,914 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741871
2015-03-13 10:33:49,915 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741935
2015-03-13 10:33:50,324 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:50,380 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:50,600 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0010_01_000001 succeeded 
2015-03-13 10:33:50,600 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:33:50,601 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0010_01_000001
2015-03-13 10:33:50,609 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001
2015-03-13 10:33:50,609 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001
2015-03-13 10:33:50,609 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001
2015-03-13 10:33:50,610 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0010/container_1426267835672_0010_01_000001
2015-03-13 10:33:50,610 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000001
2015-03-13 10:33:50,610 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0010_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:33:50,610 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0010_01_000001 from application application_1426267835672_0010
2015-03-13 10:33:50,610 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:50,610 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0010
2015-03-13 10:33:51,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:51,327 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:51,327 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:51,327 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:33:51,328 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000002, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0011_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,328 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:33:51,328 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,329 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:51,329 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:51,329 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:33:51,329 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000003, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0011_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,329 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:33:51,330 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:33:51,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0010_01_000001
2015-03-13 10:33:51,381 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0010_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:51,381 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0010_000001
2015-03-13 10:33:51,381 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0010_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:33:51,382 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0010_000001 State change from FINISHING to FINISHED
2015-03-13 10:33:51,382 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0010	CONTAINERID=container_1426267835672_0010_01_000001
2015-03-13 10:33:51,382 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0010 State change from FINISHING to FINISHED
2015-03-13 10:33:51,382 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:51,382 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0010_000001
2015-03-13 10:33:51,382 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:51,382 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0010
2015-03-13 10:33:51,383 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0010_01_000001, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,383 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0010,name=[424430AA625046EFAE20EBF78BBDDDC5/B5554EC049CD4334A41B4BB54C1B7AD7] trap test/(1/1) ...applatform/everystart/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0010/jobhistory/job/job_1426267835672_0010,appMasterHost=Edinburgh.local,startTime=1426268006031,finishTime=1426268024460,finalStatus=SUCCEEDED
2015-03-13 10:33:51,383 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,383 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:33:51,383 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0010_000001 released container container_1426267835672_0010_01_000001 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:33:51,384 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:51,384 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:51,384 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:33:51,384 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0011_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,384 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4
2015-03-13 10:33:51,384 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,385 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:33:51,385 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:51,385 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:33:51,385 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0011_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,385 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:33:51,386 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0010_000001 (auth:SIMPLE)
2015-03-13 10:33:51,386 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:51,386 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0010_000001 is done. finalState=FINISHED
2015-03-13 10:33:51,386 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0010 requests cleared
2015-03-13 10:33:51,386 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0010 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:33:51,386 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0010 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:33:51,387 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0010_01_000001
2015-03-13 10:33:51,483 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:51,484 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:51,484 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:51,484 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:33:51,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:51,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:51,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:51,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:51,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:51,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:51,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:51,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:51,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:33:51,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:33:51,588 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:33:51,589 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:33:51,592 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000004 by user soberoi
2015-03-13 10:33:51,593 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0011
2015-03-13 10:33:51,593 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:51,593 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000005 by user soberoi
2015-03-13 10:33:51,594 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:51,594 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from NEW to INITING
2015-03-13 10:33:51,594 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000004 to application application_1426267835672_0011
2015-03-13 10:33:51,594 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000005 to application application_1426267835672_0011
2015-03-13 10:33:51,594 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from INITING to RUNNING
2015-03-13 10:33:51,594 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:33:51,595 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:33:51,595 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,595 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,595 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:51,595 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:33:51,595 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:33:51,595 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:33:51,595 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,595 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,595 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:51,596 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:33:51,596 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0011_01_000005
2015-03-13 10:33:51,597 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0011_01_000004
2015-03-13 10:33:51,597 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000003 by user soberoi
2015-03-13 10:33:51,597 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000002 by user soberoi
2015-03-13 10:33:51,597 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:51,598 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000003 to application application_1426267835672_0011
2015-03-13 10:33:51,598 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000002 to application application_1426267835672_0011
2015-03-13 10:33:51,598 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:33:51,598 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:33:51,598 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,598 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,598 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:51,598 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:33:51,599 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,599 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:33:51,599 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:33:51,599 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:33:51,597 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:51,599 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:51,600 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:51,622 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0011_01_000004.tokens. Credentials list: 
2015-03-13 10:33:51,623 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0011_01_000005.tokens. Credentials list: 
2015-03-13 10:33:51,643 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:51,643 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:51,643 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:51,643 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:51,648 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:51,677 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128
2015-03-13 10:33:51,694 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128
2015-03-13 10:33:51,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003/default_container_executor.sh]
2015-03-13 10:33:51,741 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002/default_container_executor.sh]
2015-03-13 10:33:51,751 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426267835672_0011_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004.tokens
2015-03-13 10:33:51,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:33:51,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:51,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:51,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar	dst=null	perm=null
2015-03-13 10:33:51,854 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53333, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1607912123_5613, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741948_1124, duration: 504000
2015-03-13 10:33:51,880 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:51,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:51,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:51,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml	dst=null	perm=null
2015-03-13 10:33:51,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53334, bytes: 98766, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1607912123_5613, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741951_1127, duration: 285000
2015-03-13 10:33:51,928 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128
2015-03-13 10:33:51,934 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:33:51,934 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:51,935 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:33:51,977 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:51,977 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:51,978 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:33:51,978 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:52,087 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005/default_container_executor.sh]
2015-03-13 10:33:52,087 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004/default_container_executor.sh]
2015-03-13 10:33:52,327 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,328 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,328 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,328 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:52,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:52,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:52,328 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,329 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0010
2015-03-13 10:33:52,329 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:52,329 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0010, with delay of 10800 seconds
2015-03-13 10:33:52,329 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,329 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,329 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,382 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:52,382 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:33:52,382 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:52,382 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:33:52,382 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,383 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,383 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,383 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0010
2015-03-13 10:33:52,383 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0010
2015-03-13 10:33:52,383 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:33:52,383 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0010, with delay of 10800 seconds
2015-03-13 10:33:52,497 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:33:52,966 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:33:53,084 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0011_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005.tokens
2015-03-13 10:33:53,085 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:33:53,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:53,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:53,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:53,386 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:53,386 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,335 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:54,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,342 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,342 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,342 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,396 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:55,396 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,345 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,345 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:56,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,405 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,405 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:57,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:57,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:58,005 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53342, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000001_0_1183001864_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 155000
2015-03-13 10:33:58,024 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53343, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000000_0_566049093_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 160000
2015-03-13 10:33:58,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:58,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job.split	dst=null	perm=null
2015-03-13 10:33:58,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:58,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:58,180 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53346, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000000_0_566049093_1, offset: 1024, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 156000
2015-03-13 10:33:58,223 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53347, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000003_0_129198942_1, offset: 1024, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 161000
2015-03-13 10:33:58,280 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53348, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000002_0_183374136_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741949_1125, duration: 187000
2015-03-13 10:33:58,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:58,310 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53349, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000003_0_129198942_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 158000
2015-03-13 10:33:58,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,350 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,350 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:33:58,398 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53350, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000002_0_183374136_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1099000
2015-03-13 10:33:58,410 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,411 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,535 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53351, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0011_m_000001_0_1183001864_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 150000
2015-03-13 10:33:58,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_m_000001_0	dst=null	perm=null
2015-03-13 10:33:58,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_m_000000_0	dst=null	perm=null
2015-03-13 10:33:58,598 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000003
2015-03-13 10:33:58,598 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:58,598 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:33:58,598 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000003
2015-03-13 10:33:58,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,599 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:58,611 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000003 is : 143
2015-03-13 10:33:58,614 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:33:58,616 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129 src: /127.0.0.1:53352 dest: /127.0.0.1:52447
2015-03-13 10:33:58,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129 src: /127.0.0.1:53353 dest: /127.0.0.1:52454
2015-03-13 10:33:58,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129 src: /127.0.0.1:53354 dest: /127.0.0.1:52444
2015-03-13 10:33:58,624 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist for DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:33:58,625 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:58,625 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:58,626 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000003
2015-03-13 10:33:58,626 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000003 from application application_1426267835672_0011
2015-03-13 10:33:58,627 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:58,627 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:33:58,644 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000002
2015-03-13 10:33:58,644 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:58,644 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:33:58,644 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000002
2015-03-13 10:33:58,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:58,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:58,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000003
2015-03-13 10:33:58,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:58,646 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:33:58,646 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000003
2015-03-13 10:33:58,646 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:33:58,646 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:33:58,646 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000003, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:58,646 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:58,646 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:33:58,647 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000003 on node: host: 10.1.1.144:52477 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:33:58,656 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000002 is : 143
2015-03-13 10:33:58,668 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:58,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002
2015-03-13 10:33:58,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002
2015-03-13 10:33:58,670 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002
2015-03-13 10:33:58,670 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000002
2015-03-13 10:33:58,670 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:58,671 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:58,671 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000002 from application application_1426267835672_0011
2015-03-13 10:33:58,671 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:58,671 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:33:58,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_m_000003_0	dst=null	perm=null
2015-03-13 10:33:58,754 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000005
2015-03-13 10:33:58,755 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:58,755 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:33:58,755 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000005
2015-03-13 10:33:58,755 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:58,755 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:58,764 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000005 is : 143
2015-03-13 10:33:58,774 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:58,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005
2015-03-13 10:33:58,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005
2015-03-13 10:33:58,775 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005
2015-03-13 10:33:58,775 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000005
2015-03-13 10:33:58,775 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:58,775 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:58,776 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000005 from application application_1426267835672_0011
2015-03-13 10:33:58,776 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:58,776 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:33:58,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_m_000002_0	dst=null	perm=null
2015-03-13 10:33:58,798 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000004
2015-03-13 10:33:58,798 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:58,798 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:33:58,798 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000004
2015-03-13 10:33:58,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:33:58,799 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:58,799 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000005
2015-03-13 10:33:58,799 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:58,799 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:33:58,799 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000005
2015-03-13 10:33:58,799 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:33:58,800 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:33:58,800 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:58,800 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:58,800 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:33:58,800 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000005 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:33:58,808 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000004 is : 143
2015-03-13 10:33:58,816 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:33:58,817 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004
2015-03-13 10:33:58,817 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004
2015-03-13 10:33:58,817 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004
2015-03-13 10:33:58,817 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000004
2015-03-13 10:33:58,817 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:58,818 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:33:58,818 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000004 from application application_1426267835672_0011
2015-03-13 10:33:58,818 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:33:58,818 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:33:59,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:33:59,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:59,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000002
2015-03-13 10:33:59,647 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:59,647 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:33:59,647 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000002
2015-03-13 10:33:59,647 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:33:59,648 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:33:59,648 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000002, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:59,648 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:59,648 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:33:59,648 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000002 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:33:59,802 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:33:59,802 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000004
2015-03-13 10:33:59,803 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:33:59,803 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:33:59,803 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000004
2015-03-13 10:33:59,803 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:33:59,804 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:33:59,804 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:59,804 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:33:59,804 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:33:59,804 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000004 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:34:00,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:00,649 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:00,649 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:00,649 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:34:00,649 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0011 container=Container: [ContainerId: container_1426267835672_0011_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0011_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:00,649 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:34:00,650 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:01,543 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:01,552 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0011_01_000006 by user soberoi
2015-03-13 10:34:01,552 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:01,552 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0011_01_000006 to application application_1426267835672_0011
2015-03-13 10:34:01,553 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:34:01,553 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0011
2015-03-13 10:34:01,553 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0011
2015-03-13 10:34:01,553 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:01,553 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0011
2015-03-13 10:34:01,553 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:01,582 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:01,582 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:01,652 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:01,652 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:01,653 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:01,664 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006/default_container_executor.sh]
2015-03-13 10:34:02,547 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:34:02,653 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:02,653 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:03,655 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:03,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:03,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,033 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0/part-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:04,090 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130 src: /127.0.0.1:53360 dest: /127.0.0.1:52447
2015-03-13 10:34:04,091 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130 src: /127.0.0.1:53361 dest: /127.0.0.1:52454
2015-03-13 10:34:04,092 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130 src: /127.0.0.1:53362 dest: /127.0.0.1:52451
2015-03-13 10:34:04,102 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53362, dest: /127.0.0.1:52451, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0011_r_000000_0_659121923_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 8640000
2015-03-13 10:34:04,103 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,103 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,103 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53361, dest: /127.0.0.1:52454, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0011_r_000000_0_659121923_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 9282000
2015-03-13 10:34:04,103 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,104 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53360, dest: /127.0.0.1:52447, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0011_r_000000_0_659121923_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 10198000
2015-03-13 10:34:04,104 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,105 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,108 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0011_r_000000_0_659121923_1
2015-03-13 10:34:04,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0	dst=null	perm=null
2015-03-13 10:34:04,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0	dst=null	perm=null
2015-03-13 10:34:04,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/task_1426267835672_0011_r_000000	dst=null	perm=null
2015-03-13 10:34:04,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/_temporary/attempt_1426267835672_0011_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/task_1426267835672_0011_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:04,133 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000006
2015-03-13 10:34:04,134 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:04,134 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:34:04,134 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000006
2015-03-13 10:34:04,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:04,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:04,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,141 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1	dst=null	perm=null
2015-03-13 10:34:04,145 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0011_01_000006 is : 143
2015-03-13 10:34:04,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:04,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:04,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/task_1426267835672_0011_r_000000	dst=null	perm=null
2015-03-13 10:34:04,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000	dst=null	perm=null
2015-03-13 10:34:04,155 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:04,155 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary/1/task_1426267835672_0011_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,156 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:04,156 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:04,157 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000006 from application application_1426267835672_0011
2015-03-13 10:34:04,157 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:04,157 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:34:04,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary	dst=null	perm=null
2015-03-13 10:34:04,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,166 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,169 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,182 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53354, dest: /127.0.0.1:52444, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, duration: 5561701000
2015-03-13 10:34:04,183 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,183 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:04,184 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53353, dest: /127.0.0.1:52454, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, duration: 5562170000
2015-03-13 10:34:04,184 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,185 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:04,185 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53352, dest: /127.0.0.1:52447, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, duration: 5564209000
2015-03-13 10:34:04,185 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,186 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:04,187 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,191 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:04,193 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131 src: /127.0.0.1:53363 dest: /127.0.0.1:52444
2015-03-13 10:34:04,195 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131 src: /127.0.0.1:53364 dest: /127.0.0.1:52454
2015-03-13 10:34:04,196 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131 src: /127.0.0.1:53365 dest: /127.0.0.1:52451
2015-03-13 10:34:04,198 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53365, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, duration: 1512000
2015-03-13 10:34:04,198 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,199 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,199 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53364, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, duration: 1971000
2015-03-13 10:34:04,199 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,200 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,200 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53363, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, duration: 2970000
2015-03-13 10:34:04,200 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,200 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,202 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist	dst=null	perm=null
2015-03-13 10:34:04,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:34:04,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist	dst=null	perm=null
2015-03-13 10:34:04,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:34:04,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1.jhist	dst=null	perm=null
2015-03-13 10:34:04,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,223 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53366, bytes: 60422, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129, duration: 201000
2015-03-13 10:34:04,225 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:04,226 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132 src: /127.0.0.1:53367 dest: /127.0.0.1:52454
2015-03-13 10:34:04,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132 src: /127.0.0.1:53368 dest: /127.0.0.1:52444
2015-03-13 10:34:04,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132 src: /127.0.0.1:53369 dest: /127.0.0.1:52451
2015-03-13 10:34:04,231 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53369, dest: /127.0.0.1:52451, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, duration: 1674000
2015-03-13 10:34:04,231 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,232 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,232 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53368, dest: /127.0.0.1:52444, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, duration: 2315000
2015-03-13 10:34:04,232 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,232 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,233 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53367, dest: /127.0.0.1:52454, bytes: 59950, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, duration: 3125000
2015-03-13 10:34:04,233 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,233 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,235 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml	dst=null	perm=null
2015-03-13 10:34:04,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:34:04,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml	dst=null	perm=null
2015-03-13 10:34:04,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:34:04,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011/job_1426267835672_0011_1_conf.xml	dst=null	perm=null
2015-03-13 10:34:04,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:04,246 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53370, bytes: 91303, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741952_1128, duration: 274000
2015-03-13 10:34:04,248 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:04,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133 src: /127.0.0.1:53371 dest: /127.0.0.1:52454
2015-03-13 10:34:04,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133 src: /127.0.0.1:53372 dest: /127.0.0.1:52447
2015-03-13 10:34:04,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133 src: /127.0.0.1:53373 dest: /127.0.0.1:52451
2015-03-13 10:34:04,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53373, dest: /127.0.0.1:52451, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, duration: 1802000
2015-03-13 10:34:04,255 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:04,255 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53372, dest: /127.0.0.1:52447, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, duration: 2282000
2015-03-13 10:34:04,256 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,256 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53371, dest: /127.0.0.1:52454, bytes: 90595, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2098730431_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, duration: 3018000
2015-03-13 10:34:04,256 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:04,257 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:04,258 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_2098730431_1
2015-03-13 10:34:04,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0011-1426268025670-soberoi-%5B58291EFD2AED461C931D8F05D84E7429%2F844068023FDE4ED8-1426268044170-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:04,271 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from RUNNING to FINISHING
2015-03-13 10:34:04,271 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0011
2015-03-13 10:34:04,271 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from RUNNING to REMOVING
2015-03-13 10:34:04,272 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0011
2015-03-13 10:34:04,272 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from REMOVING to FINISHING
2015-03-13 10:34:05,139 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:05,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:05,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000006
2015-03-13 10:34:05,141 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:05,141 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:34:05,141 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000006
2015-03-13 10:34:05,141 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:34:05,141 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:34:05,141 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:05,142 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:05,142 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:34:05,142 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000006 on node: host: 10.1.1.144:52477 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:34:05,278 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741948_1124 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52451 127.0.0.1:52444 
2015-03-13 10:34:05,278 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741949_1125 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52447 
2015-03-13 10:34:05,278 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741950_1126 127.0.0.1:52444 127.0.0.1:52454 127.0.0.1:52451 
2015-03-13 10:34:05,278 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741951_1127 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:34:05,278 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741953_1129 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444 
2015-03-13 10:34:05,278 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741952_1128 127.0.0.1:52454 127.0.0.1:52447 127.0.0.1:52451 
2015-03-13 10:34:05,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0011	dst=null	perm=null
2015-03-13 10:34:05,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:05,317 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary
2015-03-13 10:34:05,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/_temporary	dst=null	perm=null
2015-03-13 10:34:05,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap	dst=null	perm=null
2015-03-13 10:34:05,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap	dst=null	perm=null
2015-03-13 10:34:05,329 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:05,329 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:05,329 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:05,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:05,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:05,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:05,332 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:34:05,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000	dst=null	perm=null
2015-03-13 10:34:05,335 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53375, bytes: 132, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 180000
2015-03-13 10:34:05,341 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:05,342 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:05,342 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:05,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap	dst=null	perm=null
2015-03-13 10:34:05,343 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/none/tap
2015-03-13 10:34:05,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:05,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:05,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:05,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap	dst=null	perm=null
2015-03-13 10:34:05,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000	dst=null	perm=null
2015-03-13 10:34:05,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/tap/part-00000	dst=null	perm=null
2015-03-13 10:34:05,348 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53375, bytes: 132, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130, duration: 164000
2015-03-13 10:34:05,348 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/none/trap
2015-03-13 10:34:05,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/none/trap	dst=null	perm=null
2015-03-13 10:34:05,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:34:05,359 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:05,360 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:34:05,360 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:34:05,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:05,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:05,373 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test] starting
2015-03-13 10:34:05,373 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt"]
2015-03-13 10:34:05,373 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  sink: Hfs["TextDelimited[['ip', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap"]
2015-03-13 10:34:05,374 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  parallel execution is enabled: true
2015-03-13 10:34:05,374 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  starting jobs: 1
2015-03-13 10:34:05,374 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [trap test]  allocating threads: 1
2015-03-13 10:34:05,375 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] starting step: (1/1) ...1/trapplatform/allseq/tap
2015-03-13 10:34:05,382 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:34:05,391 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:52467
2015-03-13 10:34:05,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:05,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:34:05,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:34:05,395 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 12
2015-03-13 10:34:05,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012	dst=null	perm=null
2015-03-13 10:34:05,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:34:05,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:34:05,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:05,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,401 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar. BP-1641873285-10.1.1.144-1426267833098 blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:34:05,402 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53377 dest: /127.0.0.1:52451
2015-03-13 10:34:05,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53378 dest: /127.0.0.1:52454
2015-03-13 10:34:05,404 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53379 dest: /127.0.0.1:52444
2015-03-13 10:34:05,408 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53379, dest: /127.0.0.1:52444, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 1863000
2015-03-13 10:34:05,408 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:05,409 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,409 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53378, dest: /127.0.0.1:52454, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 2295000
2015-03-13 10:34:05,409 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,409 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,409 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53377, dest: /127.0.0.1:52451, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 3374000
2015-03-13 10:34:05,410 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,410 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,411 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:34:05,412 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar
2015-03-13 10:34:05,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:05,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:34:05,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:34:05,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:34:05,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:34:05,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:34:05,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:34:05,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:34:05,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:34:05,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:34:05,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:34:05,420 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:34:05,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:34:05,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,426 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split
2015-03-13 10:34:05,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:05,428 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split. BP-1641873285-10.1.1.144-1426267833098 blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:34:05,429 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135 src: /127.0.0.1:53380 dest: /127.0.0.1:52451
2015-03-13 10:34:05,430 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135 src: /127.0.0.1:53381 dest: /127.0.0.1:52447
2015-03-13 10:34:05,431 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135 src: /127.0.0.1:53382 dest: /127.0.0.1:52454
2015-03-13 10:34:05,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135 src: /127.0.0.1:53383 dest: /127.0.0.1:52444
2015-03-13 10:34:05,435 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53383, dest: /127.0.0.1:52444, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 1502000
2015-03-13 10:34:05,436 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:05,436 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,436 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53382, dest: /127.0.0.1:52454, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 2020000
2015-03-13 10:34:05,436 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,437 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,437 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53381, dest: /127.0.0.1:52447, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 2894000
2015-03-13 10:34:05,437 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,438 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,438 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53380, dest: /127.0.0.1:52451, bytes: 1443, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 3729000
2015-03-13 10:34:05,438 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,438 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:05,440 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:34:05,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,444 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo. BP-1641873285-10.1.1.144-1426267833098 blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:05,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136 src: /127.0.0.1:53384 dest: /127.0.0.1:52451
2015-03-13 10:34:05,446 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136 src: /127.0.0.1:53385 dest: /127.0.0.1:52447
2015-03-13 10:34:05,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136 src: /127.0.0.1:53386 dest: /127.0.0.1:52454
2015-03-13 10:34:05,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53386, dest: /127.0.0.1:52454, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 1052000
2015-03-13 10:34:05,449 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:05,450 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,450 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53385, dest: /127.0.0.1:52447, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 1548000
2015-03-13 10:34:05,450 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,450 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,451 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53384, dest: /127.0.0.1:52451, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 2252000
2015-03-13 10:34:05,451 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,452 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,453 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:34:05,453 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:34:05,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:34:05,456 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:05,456 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:05,457 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:05,460 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:05,461 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137 src: /127.0.0.1:53387 dest: /127.0.0.1:52444
2015-03-13 10:34:05,462 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137 src: /127.0.0.1:53388 dest: /127.0.0.1:52451
2015-03-13 10:34:05,463 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137 src: /127.0.0.1:53389 dest: /127.0.0.1:52454
2015-03-13 10:34:05,466 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53389, dest: /127.0.0.1:52454, bytes: 98814, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 1439000
2015-03-13 10:34:05,466 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:05,467 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,467 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53388, dest: /127.0.0.1:52451, bytes: 98814, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 2067000
2015-03-13 10:34:05,467 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,468 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,468 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53387, dest: /127.0.0.1:52444, bytes: 98814, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 2854000
2015-03-13 10:34:05,468 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:05,469 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:05,470 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml is closed by DFSClient_NONMAPREDUCE_-168184016_9
2015-03-13 10:34:05,470 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426267835672_0012
2015-03-13 10:34:05,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012	dst=null	perm=null
2015-03-13 10:34:05,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:05,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:05,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:05,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:05,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:05,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:05,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:34:05,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:34:05,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:34:05,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:34:05,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:34:05,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:34:05,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:34:05,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:34:05,485 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 12 submitted by user soberoi
2015-03-13 10:34:05,485 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426267835672_0012
2015-03-13 10:34:05,485 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from NEW to NEW_SAVING
2015-03-13 10:34:05,485 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426267835672_0012
2015-03-13 10:34:05,485 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426267835672_0012
2015-03-13 10:34:05,486 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:34:05,486 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426267835672_0012_000001
2015-03-13 10:34:05,486 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from NEW to SUBMITTED
2015-03-13 10:34:05,486 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426267835672_0012 from user: soberoi activated in queue: default
2015-03-13 10:34:05,486 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426267835672_0012 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@4776af4c, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:34:05,486 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426267835672_0012 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:34:05,486 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426267835672_0012 to ResourceManager at /10.1.1.144:52467
2015-03-13 10:34:05,486 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426267835672_0012_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:34:05,487 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:34:05,488 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from SUBMITTED to ACCEPTED
2015-03-13 10:34:05,489 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:52464/proxy/application_1426267835672_0012/
2015-03-13 10:34:05,489 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] submitted hadoop job: job_1426267835672_0012
2015-03-13 10:34:05,489 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [trap test] tracking url: http://Edinburgh.local:52464/proxy/application_1426267835672_0012/
2015-03-13 10:34:05,495 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:05,495 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000001
2015-03-13 10:34:05,495 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52473, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:34:05,495 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] containerId=container_1426267835672_0012_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:05,495 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:34:05,496 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:05,496 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:05,496 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426267835672_0012 AttemptId: appattempt_1426267835672_0012_000001 MasterContainer: Container: [ContainerId: container_1426267835672_0012_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ]
2015-03-13 10:34:05,496 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:34:05,496 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426267835672_0012_000001
2015-03-13 10:34:05,496 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:34:05,497 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426267835672_0012_000001
2015-03-13 10:34:05,497 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426267835672_0012_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] for AM appattempt_1426267835672_0012_000001
2015-03-13 10:34:05,497 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426267835672_0012_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:34:05,499 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0012_000001 (auth:SIMPLE)
2015-03-13 10:34:05,500 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000001 by user soberoi
2015-03-13 10:34:05,500 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0012
2015-03-13 10:34:05,501 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000001
2015-03-13 10:34:05,501 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from NEW to INITING
2015-03-13 10:34:05,501 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000001 to application application_1426267835672_0012
2015-03-13 10:34:05,501 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from INITING to RUNNING
2015-03-13 10:34:05,501 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426267835672_0012_01_000001, NodeId: 10.1.1.144:52473, NodeHttpAddress: 10.1.1.144:52476, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52473 }, ] for AM appattempt_1426267835672_0012_000001
2015-03-13 10:34:05,501 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:34:05,501 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:34:05,501 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:05,502 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:34:05,502 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:34:05,502 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:34:05,502 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:34:05,502 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000001
2015-03-13 10:34:05,511 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0012_01_000001.tokens. Credentials list: 
2015-03-13 10:34:05,531 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:05,603 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426267835672_0012_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000001.tokens
2015-03-13 10:34:05,603 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:05,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:05,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:05,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:05,672 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53393, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1029970221_5865, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 464000
2015-03-13 10:34:05,691 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:05,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:34:05,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:34:05,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:34:05,715 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53375, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1029970221_5865, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 126000
2015-03-13 10:34:05,728 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:05,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:05,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:05,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:05,753 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53393, bytes: 1455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1029970221_5865, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 174000
2015-03-13 10:34:05,766 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:05,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:05,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:05,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:05,790 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53393, bytes: 99586, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1029970221_5865, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 280000
2015-03-13 10:34:05,802 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:05,802 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:05,828 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:05,829 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:05,897 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000001/default_container_executor.sh]
2015-03-13 10:34:06,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:06,497 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:06,497 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:06,687 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136
2015-03-13 10:34:06,688 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129
2015-03-13 10:34:06,688 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137
2015-03-13 10:34:06,709 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129
2015-03-13 10:34:06,709 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136
2015-03-13 10:34:06,710 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130
2015-03-13 10:34:06,710 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135
2015-03-13 10:34:06,711 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133
2015-03-13 10:34:06,892 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133
2015-03-13 10:34:06,893 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130
2015-03-13 10:34:06,944 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132
2015-03-13 10:34:06,946 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134
2015-03-13 10:34:06,947 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136
2015-03-13 10:34:06,947 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741954_1130
2015-03-13 10:34:06,947 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135
2015-03-13 10:34:07,059 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:52451 to replicate blk_1073741958_1134 to datanode(s) 127.0.0.1:52447
2015-03-13 10:34:07,059 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52444 to delete [blk_1073741953_1129, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126, blk_1073741951_1127]
2015-03-13 10:34:07,059 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52451 to delete [blk_1073741952_1128, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126]
2015-03-13 10:34:07,092 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134
2015-03-13 10:34:07,093 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132
2015-03-13 10:34:07,093 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131
2015-03-13 10:34:07,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135
2015-03-13 10:34:07,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:07,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137
2015-03-13 10:34:07,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131
2015-03-13 10:34:07,149 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741957_1133
2015-03-13 10:34:07,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:34:07,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:07,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:34:07,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:34:07,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:34:07,520 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741955_1131
2015-03-13 10:34:07,520 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741953_1129
2015-03-13 10:34:07,521 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137
2015-03-13 10:34:07,521 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135
2015-03-13 10:34:07,522 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741956_1132
2015-03-13 10:34:07,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012	dst=null	perm=null
2015-03-13 10:34:07,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:34:07,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:34:07,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953 for deletion
2015-03-13 10:34:07,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948 for deletion
2015-03-13 10:34:07,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949 for deletion
2015-03-13 10:34:07,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953
2015-03-13 10:34:07,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950 for deletion
2015-03-13 10:34:07,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951 for deletion
2015-03-13 10:34:07,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949
2015-03-13 10:34:07,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948
2015-03-13 10:34:07,668 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951
2015-03-13 10:34:07,668 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950
2015-03-13 10:34:07,727 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134
2015-03-13 10:34:07,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:34:07,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:34:07,896 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53395, bytes: 160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741960_1136, duration: 181000
2015-03-13 10:34:07,932 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-79468681-10.1.1.144-52451-1426267834665, infoPort=52452, ipcPort=52453, storageInfo=lv=-47;cid=testClusterID;nsid=1850867028;c=0) Starting thread to transfer BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 to 127.0.0.1:52447 
2015-03-13 10:34:07,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952 for deletion
2015-03-13 10:34:07,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948 for deletion
2015-03-13 10:34:07,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949 for deletion
2015-03-13 10:34:07,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952
2015-03-13 10:34:07,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949
2015-03-13 10:34:07,934 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 (numBytes=254067) to /127.0.0.1:52447
2015-03-13 10:34:07,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948
2015-03-13 10:34:07,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950 for deletion
2015-03-13 10:34:07,934 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53396 dest: /127.0.0.1:52447
2015-03-13 10:34:07,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950
2015-03-13 10:34:07,936 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134 src: /127.0.0.1:53396 dest: /127.0.0.1:52447 of size 254067
2015-03-13 10:34:07,936 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741958_1134 size 254067
2015-03-13 10:34:08,149 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:08,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:08,656 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0012_000001 (auth:SIMPLE)
2015-03-13 10:34:08,657 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426267835672_0012_000001
2015-03-13 10:34:08,657 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426267835672_0012	APPATTEMPTID=appattempt_1426267835672_0012_000001
2015-03-13 10:34:08,657 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:34:08,658 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from ACCEPTED to RUNNING
2015-03-13 10:34:08,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:08,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:08,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:08,864 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml. BP-1641873285-10.1.1.144-1426267833098 blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:08,903 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138 src: /127.0.0.1:53402 dest: /127.0.0.1:52447
2015-03-13 10:34:08,904 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138 src: /127.0.0.1:53403 dest: /127.0.0.1:52444
2015-03-13 10:34:08,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138 src: /127.0.0.1:53404 dest: /127.0.0.1:52454
2015-03-13 10:34:08,913 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53404, dest: /127.0.0.1:52454, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, duration: 5782000
2015-03-13 10:34:08,913 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:08,914 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:08,914 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53403, dest: /127.0.0.1:52444, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, duration: 6319000
2015-03-13 10:34:08,914 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:08,915 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:08,915 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53402, dest: /127.0.0.1:52447, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, duration: 7197000
2015-03-13 10:34:08,915 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:08,916 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:08,919 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:09,152 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:09,503 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:09,837 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:09,837 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:09,837 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:34:09,837 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0012_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,838 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:34:09,838 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,839 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:09,839 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:09,839 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:34:09,839 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0012_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,839 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:34:09,840 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,840 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:09,840 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:09,840 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:34:09,840 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0012_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,841 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:34:09,841 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,841 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:09,841 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:09,841 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:34:09,841 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] containerId=container_1426267835672_0012_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:09,841 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:34:09,842 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:10,061 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52454 to delete [blk_1073741952_1128, blk_1073741953_1129, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126, blk_1073741951_1127]
2015-03-13 10:34:10,062 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:52447 to delete [blk_1073741952_1128, blk_1073741953_1129, blk_1073741948_1124, blk_1073741949_1125, blk_1073741951_1127]
2015-03-13 10:34:10,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,413 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426267835672_0011_01_000001 succeeded 
2015-03-13 10:34:10,413 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:34:10,413 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0011_01_000001
2015-03-13 10:34:10,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001
2015-03-13 10:34:10,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001
2015-03-13 10:34:10,421 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000001
2015-03-13 10:34:10,421 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0011_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:34:10,421 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0011_01_000001 from application application_1426267835672_0011
2015-03-13 10:34:10,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001
2015-03-13 10:34:10,422 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011/container_1426267835672_0011_01_000001
2015-03-13 10:34:10,422 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:10,422 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0011
2015-03-13 10:34:10,508 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952 for deletion
2015-03-13 10:34:10,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953 for deletion
2015-03-13 10:34:10,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948 for deletion
2015-03-13 10:34:10,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952
2015-03-13 10:34:10,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949 for deletion
2015-03-13 10:34:10,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951 for deletion
2015-03-13 10:34:10,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953
2015-03-13 10:34:10,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949
2015-03-13 10:34:10,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948
2015-03-13 10:34:10,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951
2015-03-13 10:34:10,689 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:10,689 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:10,690 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:10,690 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:10,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:10,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:10,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:10,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:10,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:34:10,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:34:10,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:34:10,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:34:10,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:34:10,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-8696053933626646702.jar	dst=null	perm=null
2015-03-13 10:34:10,814 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0012_000001 (auth:SIMPLE)
2015-03-13 10:34:10,817 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000002 by user soberoi
2015-03-13 10:34:10,818 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000005 by user soberoi
2015-03-13 10:34:10,818 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000004 by user soberoi
2015-03-13 10:34:10,818 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000003 by user soberoi
2015-03-13 10:34:10,818 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:10,818 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000005 to application application_1426267835672_0012
2015-03-13 10:34:10,818 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000004 to application application_1426267835672_0012
2015-03-13 10:34:10,818 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000003 to application application_1426267835672_0012
2015-03-13 10:34:10,818 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0012
2015-03-13 10:34:10,818 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:10,818 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:10,819 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from NEW to INITING
2015-03-13 10:34:10,819 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000002 to application application_1426267835672_0012
2015-03-13 10:34:10,819 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from INITING to RUNNING
2015-03-13 10:34:10,819 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:34:10,819 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:34:10,820 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:34:10,820 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:34:10,820 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,820 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,820 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:10,820 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:10,820 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:34:10,820 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:34:10,820 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,820 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,820 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:10,820 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:10,821 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,821 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,821 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:10,821 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:10,818 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:10,821 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,821 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:10,821 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:10,821 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:10,821 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000002
2015-03-13 10:34:10,822 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000004
2015-03-13 10:34:10,823 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000003
2015-03-13 10:34:10,825 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000005
2015-03-13 10:34:10,837 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,837 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,837 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,838 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:10,838 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:10,838 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:10,838 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:10,838 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:10,842 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000002.tokens. Credentials list: 
2015-03-13 10:34:10,842 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000005.tokens. Credentials list: 
2015-03-13 10:34:10,843 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0012_01_000003.tokens. Credentials list: 
2015-03-13 10:34:10,843 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000004.tokens. Credentials list: 
2015-03-13 10:34:10,857 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:10,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002.tokens
2015-03-13 10:34:10,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:10,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:10,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:10,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:10,995 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53408, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1439600372_5977, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 537000
2015-03-13 10:34:11,022 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:11,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:11,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:11,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:11,045 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53408, bytes: 99586, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1439600372_5977, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 198000
2015-03-13 10:34:11,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952 for deletion
2015-03-13 10:34:11,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953 for deletion
2015-03-13 10:34:11,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948 for deletion
2015-03-13 10:34:11,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741952
2015-03-13 10:34:11,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741953
2015-03-13 10:34:11,053 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741948
2015-03-13 10:34:11,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949 for deletion
2015-03-13 10:34:11,053 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950 for deletion
2015-03-13 10:34:11,053 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951 for deletion
2015-03-13 10:34:11,053 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741949
2015-03-13 10:34:11,053 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741951
2015-03-13 10:34:11,053 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1641873285-10.1.1.144-1426267833098 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1641873285-10.1.1.144-1426267833098/current/finalized/blk_1073741950
2015-03-13 10:34:11,059 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:11,059 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:11,059 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:11,059 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:11,059 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:11,101 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:11,102 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:11,102 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:11,102 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:11,102 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:11,102 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:11,102 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:11,102 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:11,156 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:34:11,156 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0011_01_000001
2015-03-13 10:34:11,156 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0011_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:11,156 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426267835672_0011_000001
2015-03-13 10:34:11,157 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0011_000001 State change from FINISHING to FINISHED
2015-03-13 10:34:11,157 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0011 State change from FINISHING to FINISHED
2015-03-13 10:34:11,157 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426267835672_0011
2015-03-13 10:34:11,156 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0011_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:34:11,157 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426267835672_0011,name=[58291EFD2AED461C931D8F05D84E7429/844068023FDE4ED89D2CDA92C3503422] trap test/(1/1) ...mr1/trapplatform/none/tap,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:52464/proxy/application_1426267835672_0011/jobhistory/job/job_1426267835672_0011,appMasterHost=Edinburgh.local,startTime=1426268025670,finishTime=1426268044272,finalStatus=SUCCEEDED
2015-03-13 10:34:11,157 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426267835672_0011_000001
2015-03-13 10:34:11,157 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0011	CONTAINERID=container_1426267835672_0011_01_000001
2015-03-13 10:34:11,158 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:34:11,158 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:34:11,158 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0011_01_000001, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:11,158 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:11,158 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:34:11,158 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0011_000001 released container container_1426267835672_0011_01_000001 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:34:11,158 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426267835672_0011_000001 is done. finalState=FINISHED
2015-03-13 10:34:11,158 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426267835672_0011 requests cleared
2015-03-13 10:34:11,158 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426267835672_0011 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:34:11,159 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426267835672_0011 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:34:11,161 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0011_000001 (auth:SIMPLE)
2015-03-13 10:34:11,163 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0011_01_000001
2015-03-13 10:34:11,210 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003/default_container_executor.sh]
2015-03-13 10:34:11,210 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005/default_container_executor.sh]
2015-03-13 10:34:11,210 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004/default_container_executor.sh]
2015-03-13 10:34:11,211 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002/default_container_executor.sh]
2015-03-13 10:34:11,512 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,704 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:34:11,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:11,844 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:34:11,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:11,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:11,844 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0011
2015-03-13 10:34:11,844 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:34:11,844 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0011, with delay of 10800 seconds
2015-03-13 10:34:11,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:11,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:11,923 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134
2015-03-13 10:34:11,924 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138
2015-03-13 10:34:12,088 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:12,099 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138
2015-03-13 10:34:12,161 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:34:12,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:12,162 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426267835672_0011
2015-03-13 10:34:12,162 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:34:12,162 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426267835672_0011, with delay of 10800 seconds
2015-03-13 10:34:12,162 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:12,162 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:12,162 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0011
2015-03-13 10:34:12,202 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004.tokens
2015-03-13 10:34:12,202 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:12,306 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:12,454 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426267835672_0012_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003.tokens
2015-03-13 10:34:12,455 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:12,516 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:12,568 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:12,682 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426267835672_0012_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005.tokens
2015-03-13 10:34:12,683 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:12,732 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138
2015-03-13 10:34:12,847 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:12,847 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:12,847 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:12,848 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,517 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,849 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,849 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,849 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:13,850 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,519 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,855 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,855 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,855 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:14,856 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,522 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,857 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:15,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,861 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:16,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:17,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:17,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:17,530 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53420, bytes: 423, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 177000
2015-03-13 10:34:17,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.split	dst=null	perm=null
2015-03-13 10:34:17,630 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53421, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 164000
2015-03-13 10:34:17,658 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53423, bytes: 939, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 512, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 206000
2015-03-13 10:34:17,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:34:17,698 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53420, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 512, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 166000
2015-03-13 10:34:17,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53424, bytes: 1455, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741959_1135, duration: 150000
2015-03-13 10:34:17,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:34:17,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:34:17,758 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53425, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 174000
2015-03-13 10:34:17,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/apache.10.txt	dst=null	perm=null
2015-03-13 10:34:17,799 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53426, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 1024, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 150000
2015-03-13 10:34:17,866 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:17,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary	dst=null	perm=null
2015-03-13 10:34:18,107 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53427, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741827_1003, duration: 1156000
2015-03-13 10:34:18,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary	dst=null	perm=null
2015-03-13 10:34:18,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,155 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003. BP-1641873285-10.1.1.144-1426267833098 blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]}
2015-03-13 10:34:18,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary	dst=null	perm=null
2015-03-13 10:34:18,187 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001. BP-1641873285-10.1.1.144-1426267833098 blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:18,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139 src: /127.0.0.1:53428 dest: /127.0.0.1:52454
2015-03-13 10:34:18,230 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139 src: /127.0.0.1:53430 dest: /127.0.0.1:52444
2015-03-13 10:34:18,231 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139 src: /127.0.0.1:53431 dest: /127.0.0.1:52447
2015-03-13 10:34:18,235 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140 src: /127.0.0.1:53429 dest: /127.0.0.1:52447
2015-03-13 10:34:18,237 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140 src: /127.0.0.1:53432 dest: /127.0.0.1:52451
2015-03-13 10:34:18,238 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140 src: /127.0.0.1:53433 dest: /127.0.0.1:52454
2015-03-13 10:34:18,241 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53431, dest: /127.0.0.1:52447, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 9129000
2015-03-13 10:34:18,242 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:18,242 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:34:18,242 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53430, dest: /127.0.0.1:52444, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 9819000
2015-03-13 10:34:18,242 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,243 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:34:18,243 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53428, dest: /127.0.0.1:52454, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 10627000
2015-03-13 10:34:18,243 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,244 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW]]} size 0
2015-03-13 10:34:18,248 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003 is closed by DFSClient_attempt_1426267835672_0012_m_000003_0_-2017675760_1
2015-03-13 10:34:18,248 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53433, dest: /127.0.0.1:52454, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 8710000
2015-03-13 10:34:18,249 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:18,249 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,249 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53432, dest: /127.0.0.1:52451, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 8460000
2015-03-13 10:34:18,249 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,250 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,250 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53429, dest: /127.0.0.1:52447, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 9272000
2015-03-13 10:34:18,250 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,251 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0	dst=null	perm=null
2015-03-13 10:34:18,255 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001 is closed by DFSClient_attempt_1426267835672_0012_m_000001_0_-1761546042_1
2015-03-13 10:34:18,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0	dst=null	perm=null
2015-03-13 10:34:18,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0	dst=null	perm=null
2015-03-13 10:34:18,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0	dst=null	perm=null
2015-03-13 10:34:18,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0	dst=null	perm=null
2015-03-13 10:34:18,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0	dst=null	perm=null
2015-03-13 10:34:18,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0	dst=null	perm=null
2015-03-13 10:34:18,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0	dst=null	perm=null
2015-03-13 10:34:18,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0	dst=null	perm=null
2015-03-13 10:34:18,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:34:18,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0	dst=null	perm=null
2015-03-13 10:34:18,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0/part-m-00001-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000003_0	dst=null	perm=null
2015-03-13 10:34:18,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:34:18,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0/part-m-00001-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000001_0	dst=null	perm=null
2015-03-13 10:34:18,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_m_000003_0	dst=null	perm=null
2015-03-13 10:34:18,341 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002. BP-1641873285-10.1.1.144-1426267833098 blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:18,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_m_000001_0	dst=null	perm=null
2015-03-13 10:34:18,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary	dst=null	perm=null
2015-03-13 10:34:18,370 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000005
2015-03-13 10:34:18,370 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:18,370 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:34:18,370 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000005
2015-03-13 10:34:18,370 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:18,383 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000005 is : 143
2015-03-13 10:34:18,385 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist. BP-1641873285-10.1.1.144-1426267833098 blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]}
2015-03-13 10:34:18,387 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142 src: /127.0.0.1:53435 dest: /127.0.0.1:52447
2015-03-13 10:34:18,389 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142 src: /127.0.0.1:53436 dest: /127.0.0.1:52451
2015-03-13 10:34:18,390 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142 src: /127.0.0.1:53437 dest: /127.0.0.1:52444
2015-03-13 10:34:18,394 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist for DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:18,397 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:18,398 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005
2015-03-13 10:34:18,398 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005
2015-03-13 10:34:18,398 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005
2015-03-13 10:34:18,398 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000005
2015-03-13 10:34:18,398 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:18,399 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:18,399 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000005 from application application_1426267835672_0012
2015-03-13 10:34:18,399 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:18,399 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:18,400 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141 src: /127.0.0.1:53434 dest: /127.0.0.1:52447
2015-03-13 10:34:18,401 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141 src: /127.0.0.1:53438 dest: /127.0.0.1:52451
2015-03-13 10:34:18,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141 src: /127.0.0.1:53439 dest: /127.0.0.1:52454
2015-03-13 10:34:18,408 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000003
2015-03-13 10:34:18,409 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:18,409 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:34:18,409 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000003
2015-03-13 10:34:18,409 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,409 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:18,410 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,410 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:18,410 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000005
2015-03-13 10:34:18,411 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:18,411 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:34:18,411 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000005
2015-03-13 10:34:18,411 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:34:18,411 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:34:18,411 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000005, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,411 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,411 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:34:18,411 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000005 on node: host: 10.1.1.144:52481 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:34:18,413 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53439, dest: /127.0.0.1:52454, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 8103000
2015-03-13 10:34:18,413 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:18,414 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53438, dest: /127.0.0.1:52451, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 8908000
2015-03-13 10:34:18,414 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,414 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,415 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53434, dest: /127.0.0.1:52447, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 10354000
2015-03-13 10:34:18,415 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,417 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,418 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:18,423 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000003 is : 143
2015-03-13 10:34:18,427 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002 is closed by DFSClient_attempt_1426267835672_0012_m_000002_0_46359667_1
2015-03-13 10:34:18,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0	dst=null	perm=null
2015-03-13 10:34:18,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0	dst=null	perm=null
2015-03-13 10:34:18,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0	dst=null	perm=null
2015-03-13 10:34:18,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0	dst=null	perm=null
2015-03-13 10:34:18,436 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:18,436 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003
2015-03-13 10:34:18,436 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003
2015-03-13 10:34:18,436 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003
2015-03-13 10:34:18,437 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:18,437 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:18,437 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000003 from application application_1426267835672_0012
2015-03-13 10:34:18,437 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:18,437 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000003
2015-03-13 10:34:18,437 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:18,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0	dst=null	perm=null
2015-03-13 10:34:18,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:34:18,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0/part-m-00001-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,464 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000. BP-1641873285-10.1.1.144-1426267833098 blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:18,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000002_0	dst=null	perm=null
2015-03-13 10:34:18,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_m_000002_0	dst=null	perm=null
2015-03-13 10:34:18,503 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000004
2015-03-13 10:34:18,503 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:18,503 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:34:18,504 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,504 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:18,504 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000003
2015-03-13 10:34:18,504 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:18,505 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000004
2015-03-13 10:34:18,505 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:18,505 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:34:18,505 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000003
2015-03-13 10:34:18,505 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:34:18,505 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:34:18,506 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000003, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,506 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,506 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:34:18,506 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000003 on node: host: 10.1.1.144:52481 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:34:18,520 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000004 is : 143
2015-03-13 10:34:18,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143 src: /127.0.0.1:53440 dest: /127.0.0.1:52447
2015-03-13 10:34:18,527 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143 src: /127.0.0.1:53441 dest: /127.0.0.1:52454
2015-03-13 10:34:18,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143 src: /127.0.0.1:53442 dest: /127.0.0.1:52451
2015-03-13 10:34:18,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:18,533 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:18,534 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004
2015-03-13 10:34:18,534 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004
2015-03-13 10:34:18,534 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004
2015-03-13 10:34:18,535 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000004
2015-03-13 10:34:18,535 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:18,535 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:18,535 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000004 from application application_1426267835672_0012
2015-03-13 10:34:18,536 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:18,536 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:18,537 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53442, dest: /127.0.0.1:52451, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 6945000
2015-03-13 10:34:18,537 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:18,538 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:18,538 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53441, dest: /127.0.0.1:52454, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 7791000
2015-03-13 10:34:18,538 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,538 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:18,539 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53440, dest: /127.0.0.1:52447, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 8871000
2015-03-13 10:34:18,539 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:18,539 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:18,545 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000 is closed by DFSClient_attempt_1426267835672_0012_m_000000_0_-89985735_1
2015-03-13 10:34:18,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0	dst=null	perm=null
2015-03-13 10:34:18,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0	dst=null	perm=null
2015-03-13 10:34:18,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0	dst=null	perm=null
2015-03-13 10:34:18,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0	dst=null	perm=null
2015-03-13 10:34:18,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0	dst=null	perm=null
2015-03-13 10:34:18,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:18,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:34:18,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0/part-m-00001-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:18,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary/_attempt_1426267835672_0012_m_000000_0	dst=null	perm=null
2015-03-13 10:34:18,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_m_000000_0	dst=null	perm=null
2015-03-13 10:34:18,605 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000002
2015-03-13 10:34:18,606 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:18,606 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:34:18,606 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000002
2015-03-13 10:34:18,606 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:18,606 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:18,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000004
2015-03-13 10:34:18,607 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:18,607 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:34:18,607 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000004
2015-03-13 10:34:18,607 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:34:18,607 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:34:18,607 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000004, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,608 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:18,608 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:34:18,608 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000004 on node: host: 10.1.1.144:52481 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:34:18,616 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000002 is : 143
2015-03-13 10:34:18,624 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:18,625 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002
2015-03-13 10:34:18,625 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002
2015-03-13 10:34:18,625 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002
2015-03-13 10:34:18,625 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000002
2015-03-13 10:34:18,626 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:18,626 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:18,627 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000002 from application application_1426267835672_0012
2015-03-13 10:34:18,627 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:18,628 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:19,536 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:19,612 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:19,612 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000002
2015-03-13 10:34:19,612 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:19,613 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:34:19,613 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000002
2015-03-13 10:34:19,613 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52481, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:34:19,613 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:34:19,613 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000002, NodeId: 10.1.1.144:52481, NodeHttpAddress: 10.1.1.144:52484, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:52481 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:19,613 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:19,614 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:34:19,614 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000002 on node: host: 10.1.1.144:52481 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:34:20,193 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:34:20,193 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:20,193 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426267835672_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:34:20,194 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426267835672_0012 container=Container: [ContainerId: container_1426267835672_0012_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] containerId=container_1426267835672_0012_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:20,194 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:34:20,194 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:20,537 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:20,750 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:34:20,761 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426267835672_0012_000001 (auth:SIMPLE)
2015-03-13 10:34:20,763 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426267835672_0012_01_000006 by user soberoi
2015-03-13 10:34:20,763 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426267835672_0012
2015-03-13 10:34:20,764 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:20,764 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from NEW to INITING
2015-03-13 10:34:20,764 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426267835672_0012_01_000006 to application application_1426267835672_0012
2015-03-13 10:34:20,764 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426267835672_0012 transitioned from INITING to RUNNING
2015-03-13 10:34:20,764 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:34:20,764 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426267835672_0012
2015-03-13 10:34:20,764 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426267835672_0012
2015-03-13 10:34:20,765 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:34:20,765 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426267835672_0012
2015-03-13 10:34:20,765 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:34:20,765 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:34:20,765 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426267835672_0012_01_000006
2015-03-13 10:34:20,775 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0012_01_000006.tokens. Credentials list: 
2015-03-13 10:34:20,796 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:34:20,879 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426267835672_0012_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006.tokens
2015-03-13 10:34:20,879 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0012
2015-03-13 10:34:20,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:20,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:20,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar	dst=null	perm=null
2015-03-13 10:34:20,961 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53446, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_791227813_6267, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741958_1134, duration: 475000
2015-03-13 10:34:20,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:21,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:21,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:21,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml	dst=null	perm=null
2015-03-13 10:34:21,011 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52444, dest: /127.0.0.1:53447, bytes: 99586, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_791227813_6267, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741961_1137, duration: 324000
2015-03-13 10:34:21,025 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:52443/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:34:21,025 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:34:21,051 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:34:21,051 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:21,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006/default_container_executor.sh]
2015-03-13 10:34:21,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:21,193 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:34:21,538 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:21,756 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:34:21,935 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141
2015-03-13 10:34:21,936 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139
2015-03-13 10:34:21,936 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140
2015-03-13 10:34:21,936 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143
2015-03-13 10:34:22,109 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140
2015-03-13 10:34:22,109 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139
2015-03-13 10:34:22,109 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141
2015-03-13 10:34:22,110 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143
2015-03-13 10:34:22,155 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141
2015-03-13 10:34:22,156 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143
2015-03-13 10:34:22,156 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140
2015-03-13 10:34:22,197 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:22,543 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:22,742 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139
2015-03-13 10:34:23,197 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:23,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,545 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0/part-00000 is closed by DFSClient_attempt_1426267835672_0012_r_000000_0_-1942593888_1
2015-03-13 10:34:23,548 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:23,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0	dst=null	perm=null
2015-03-13 10:34:23,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0	dst=null	perm=null
2015-03-13 10:34:23,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/task_1426267835672_0012_r_000000	dst=null	perm=null
2015-03-13 10:34:23,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/_temporary/attempt_1426267835672_0012_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/task_1426267835672_0012_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:34:23,570 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426267835672_0012_01_000006
2015-03-13 10:34:23,571 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:23,571 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:34:23,571 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426267835672_0012_01_000006
2015-03-13 10:34:23,571 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:34:23,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,577 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1	dst=null	perm=null
2015-03-13 10:34:23,581 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426267835672_0012_01_000006 is : 143
2015-03-13 10:34:23,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:23,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:23,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/task_1426267835672_0012_r_000000	dst=null	perm=null
2015-03-13 10:34:23,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000	dst=null	perm=null
2015-03-13 10:34:23,590 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:34:23,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006
2015-03-13 10:34:23,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006
2015-03-13 10:34:23,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006
2015-03-13 10:34:23,591 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426267835672_0012/container_1426267835672_0012_01_000006
2015-03-13 10:34:23,590 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:23,591 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426267835672_0012_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:34:23,591 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426267835672_0012_01_000006 from application application_1426267835672_0012
2015-03-13 10:34:23,591 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:34:23,591 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426267835672_0012
2015-03-13 10:34:23,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary/1/task_1426267835672_0012_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary	dst=null	perm=null
2015-03-13 10:34:23,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,601 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,604 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,617 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53437, dest: /127.0.0.1:52444, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, duration: 5224572000
2015-03-13 10:34:23,617 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:23,618 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:23,618 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53436, dest: /127.0.0.1:52451, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, duration: 5225794000
2015-03-13 10:34:23,618 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,619 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:23,619 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53435, dest: /127.0.0.1:52447, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, duration: 5227057000
2015-03-13 10:34:23,620 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,620 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW]]} size 0
2015-03-13 10:34:23,621 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,625 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:23,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144 src: /127.0.0.1:53452 dest: /127.0.0.1:52451
2015-03-13 10:34:23,629 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144 src: /127.0.0.1:53453 dest: /127.0.0.1:52444
2015-03-13 10:34:23,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144 src: /127.0.0.1:53454 dest: /127.0.0.1:52454
2015-03-13 10:34:23,632 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53454, dest: /127.0.0.1:52454, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, duration: 1301000
2015-03-13 10:34:23,633 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:23,633 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,633 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53453, dest: /127.0.0.1:52444, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, duration: 1783000
2015-03-13 10:34:23,633 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,634 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,634 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53452, dest: /127.0.0.1:52451, bytes: 453, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, duration: 2760000
2015-03-13 10:34:23,634 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,635 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52451|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,636 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist	dst=null	perm=null
2015-03-13 10:34:23,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:34:23,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist	dst=null	perm=null
2015-03-13 10:34:23,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:34:23,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1.jhist	dst=null	perm=null
2015-03-13 10:34:23,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,652 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53455, bytes: 58234, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741966_1142, duration: 214000
2015-03-13 10:34:23,654 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]}
2015-03-13 10:34:23,655 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145 src: /127.0.0.1:53456 dest: /127.0.0.1:52454
2015-03-13 10:34:23,656 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145 src: /127.0.0.1:53457 dest: /127.0.0.1:52447
2015-03-13 10:34:23,657 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145 src: /127.0.0.1:53458 dest: /127.0.0.1:52451
2015-03-13 10:34:23,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53458, dest: /127.0.0.1:52451, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, duration: 1705000
2015-03-13 10:34:23,660 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:23,660 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52451 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:23,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53457, dest: /127.0.0.1:52447, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, duration: 2245000
2015-03-13 10:34:23,661 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,661 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:23,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53456, dest: /127.0.0.1:52454, bytes: 57782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, duration: 2993000
2015-03-13 10:34:23,661 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,662 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52454|RBW], ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52451|RBW]]} size 0
2015-03-13 10:34:23,663 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml	dst=null	perm=null
2015-03-13 10:34:23,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:34:23,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml	dst=null	perm=null
2015-03-13 10:34:23,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:34:23,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012/job_1426267835672_0012_1_conf.xml	dst=null	perm=null
2015-03-13 10:34:23,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:34:23,675 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53459, bytes: 92125, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741962_1138, duration: 304000
2015-03-13 10:34:23,677 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp. BP-1641873285-10.1.1.144-1426267833098 blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]}
2015-03-13 10:34:23,679 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146 src: /127.0.0.1:53460 dest: /127.0.0.1:52447
2015-03-13 10:34:23,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146 src: /127.0.0.1:53461 dest: /127.0.0.1:52444
2015-03-13 10:34:23,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146 src: /127.0.0.1:53462 dest: /127.0.0.1:52454
2015-03-13 10:34:23,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53462, dest: /127.0.0.1:52454, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, duration: 1747000
2015-03-13 10:34:23,685 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:34:23,685 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52454 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,685 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53461, dest: /127.0.0.1:52444, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-218115309-10.1.1.144-52444-1426267834377, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, duration: 2208000
2015-03-13 10:34:23,685 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,686 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52444 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,686 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:53460, dest: /127.0.0.1:52447, bytes: 91409, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-644782047_1, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, duration: 2978000
2015-03-13 10:34:23,686 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1641873285-10.1.1.144-1426267833098:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:34:23,686 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52447 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:52447|RBW], ReplicaUnderConstruction[127.0.0.1:52444|RBW], ReplicaUnderConstruction[127.0.0.1:52454|RBW]]} size 0
2015-03-13 10:34:23,688 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-644782047_1
2015-03-13 10:34:23,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426267835672_0012-1426268045485-soberoi-%5B9EA7F51F12764E628251D99667CD3C3D%2FA6B81ED985794D09-1426268063605-4-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:34:23,701 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426267835672_0012_000001 State change from RUNNING to FINISHING
2015-03-13 10:34:23,701 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426267835672_0012
2015-03-13 10:34:23,701 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from RUNNING to REMOVING
2015-03-13 10:34:23,701 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426267835672_0012
2015-03-13 10:34:23,702 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426267835672_0012 State change from REMOVING to FINISHING
2015-03-13 10:34:24,552 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:34:24,572 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426267835672 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:34:24,572 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426267835672_0012_01_000006
2015-03-13 10:34:24,573 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426267835672_0012_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:34:24,573 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426267835672_0012_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:34:24,573 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426267835672_0012	CONTAINERID=container_1426267835672_0012_01_000006
2015-03-13 10:34:24,573 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426267835672_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:52477, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:34:24,573 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:34:24,574 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426267835672_0012_01_000006, NodeId: 10.1.1.144:52477, NodeHttpAddress: 10.1.1.144:52480, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:52477 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:24,574 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:34:24,574 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:34:24,574 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426267835672_0012_000001 released container container_1426267835672_0012_01_000006 on node: host: 10.1.1.144:52477 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:34:24,713 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741958_1134 127.0.0.1:52451 127.0.0.1:52454 127.0.0.1:52444 127.0.0.1:52447 
2015-03-13 10:34:24,713 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741959_1135 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454 127.0.0.1:52444 
2015-03-13 10:34:24,713 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741960_1136 127.0.0.1:52451 127.0.0.1:52447 127.0.0.1:52454 
2015-03-13 10:34:24,714 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741961_1137 127.0.0.1:52444 127.0.0.1:52451 127.0.0.1:52454 
2015-03-13 10:34:24,714 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741966_1142 127.0.0.1:52447 127.0.0.1:52451 127.0.0.1:52444 
2015-03-13 10:34:24,714 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741962_1138 127.0.0.1:52447 127.0.0.1:52444 127.0.0.1:52454 
2015-03-13 10:34:24,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426267835672_0012	dst=null	perm=null
2015-03-13 10:34:24,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:24,742 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary
2015-03-13 10:34:24,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/_temporary	dst=null	perm=null
2015-03-13 10:34:24,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,744 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary
2015-03-13 10:34:24,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary	dst=null	perm=null
2015-03-13 10:34:24,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary	dst=null	perm=null
2015-03-13 10:34:24,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,746 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary
2015-03-13 10:34:24,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/_temporary	dst=null	perm=null
2015-03-13 10:34:24,753 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:24,754 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:24,754 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:24,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:24,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:24,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:24,757 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:34:24,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000	dst=null	perm=null
2015-03-13 10:34:24,764 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:34:24,764 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:34:24,765 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:34:24,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,768 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:34:24,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:34:24,771 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53464, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 167000
2015-03-13 10:34:24,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:34:24,773 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53464, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 154000
2015-03-13 10:34:24,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:34:24,775 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53465, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 177000
2015-03-13 10:34:24,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:34:24,777 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53465, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 167000
2015-03-13 10:34:24,777 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/allseq/trap
2015-03-13 10:34:24,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap	dst=null	perm=null
2015-03-13 10:34:24,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:34:24,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00000	dst=null	perm=null
2015-03-13 10:34:24,782 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52447, dest: /127.0.0.1:53464, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-898105819-10.1.1.144-52447-1426267834396, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741967_1143, duration: 175000
2015-03-13 10:34:24,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:34:24,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00001	dst=null	perm=null
2015-03-13 10:34:24,785 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53466, bytes: 45, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741964_1140, duration: 176000
2015-03-13 10:34:24,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:34:24,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00002	dst=null	perm=null
2015-03-13 10:34:24,788 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52451, dest: /127.0.0.1:53466, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-79468681-10.1.1.144-52451-1426267834665, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741965_1141, duration: 162000
2015-03-13 10:34:24,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:34:24,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/trap/part-m-00001-00003	dst=null	perm=null
2015-03-13 10:34:24,790 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:52454, dest: /127.0.0.1:53465, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-168184016_9, offset: 0, srvID: DS-1285499800-10.1.1.144-52454-1426267834827, blockid: BP-1641873285-10.1.1.144-1426267833098:blk_1073741963_1139, duration: 131000
2015-03-13 10:34:24,791 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/trapplatform/allseq/tap
2015-03-13 10:34:24,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:24,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:24,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:24,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap	dst=null	perm=null
2015-03-13 10:34:24,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000	dst=null	perm=null
2015-03-13 10:34:24,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/trapplatform/allseq/tap/part-00000	dst=null	perm=null

Standard error

Mar 13, 2015 10:30:37 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:30:37 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Mar 13, 2015 10:30:37 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:30:37 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:30:37 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:38 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:38 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:38 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:30:38 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:30:38 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:30:38 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:30:38 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:30:38 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:38 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:38 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:38 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:30:39 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:30:39 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:30:39 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:30:39 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:30:39 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:39 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:40 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:40 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:30:41 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:30:41 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:30:41 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:30:41 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:30:41 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:41 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:41 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:41 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:30:42 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:30:42 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:30:42 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:30:42 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:30:42 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:42 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:42 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:30:42 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.